what ai companies get wrong about curing cancer with emilia javorsky

flagship promise across tech companies that are developing artificial general intelligence or super intelligence has been cure cancer. Don't we want to cure cancer? How could you be against the development of this technology? You're holding up cancer treatments. Think of the children here on a deep human level. That's not a promise that you throw around lightly or flippantly given how deep of a problem this is and how deeply this affects everyone's lives. In general, grand challenges just don't tend to be sort of intelligence limited problems. There are problems around data. There problems around incentives. There problems around coordination. At the basic science level, there's actually very little data that is in a format or accessible to being trained by AI. Super intelligence cannot model something that does not have first principles and does not have data. we have a system that fundamentally rewards incremental thinking and not necessarily rewards out of the box thinking. So like step one is like how can we actually use AI systems to encourage out of the box ideas just as much as the inside of the box ones to get more of those going. >> Welcome to the Future of Life Institute podcast. My name is Gus Stalker and I'm here with my colleague Emmelia Javorski. Amelia, welcome to the show. >> Thank you so much for having me Gus. Great. You have a new essay called AI versus cancer. That's a long walk through of everything we know about what AI can and can't help with when it comes to cancer. So maybe we want to we want to start with you and uh and and your sort of background and credentials and then talk a little bit about the problem of cancer and before we get into the meat of the essay. [snorts] >> Absolutely. Thank you Gus. So my background I am a physician and scientist by training and before I went to medical school had a former career in public health and so throughout my career I've touched a lot of different aspects of the healthcare and discovery ecosystem from the macro public health side of things down to being a posttock and doing bench research to being in the clinic to co-founding a startup. So I've actually had the opportunity to see each of those phases of development of a new therapy and get sort of the insight into how the sausage is made and like what is the narrative of how these things happen and then what's actually happening in the field and on the ground of how these things happen and by sort of a series of events as life is I originally was involved in sort of biocurity about 10 years ago and became interested in the intersection of that at that time the emerging idea of AI that was coming onto the scene and have been involved since then in the AI conversation for the better part of 9 10 years and for a long time these two lives I had were very disconnected talking about AI policy and the quest for super intelligence and then doing science in the lab and thinking about how to actually get new therapies to patients and those kind of collided in recent years with this promise that's coming out of a lot of the big tech companies that this technology in fact will deliver cancer cures which has kind of been one of their flagship promises. So I decided to say, "Hey, like we should break that down." And I've been pretty surprised how unexamined that promise has gone in sort of popular culture in throughout narratives and media and news that it's kind of accepted at face value that oh this technology will do this thing that is being claimed. And so I kind of felt seeing the disconnect between where the state of that technology is and how that problem's being approached from the AI side and knowing what's actually happening on the ground on the biotech and medical side. Highlighting where that delta is and where technology can and can't move the needle. >> Yeah. Great. So maybe let's start with that promise. Maybe describe to me what does that promise look like from the AI companies? What do they believe about how AI will cure cancer? >> Yes. So this has been remarkably conserved flagship promise across tech companies that are developing artificial general intelligence or super intelligence that this technology is necessary for XYZ and flagship promise has been cure cancer. Don't we want to cure cancer? This will cure cancer. How could you be against the development of this technology? you're holding up cancer treatments, think of the children here. Um, and I think that that hit me both as a professional coming from the medical world, but also personally because my father passed away of cancer and I think everyone knows a family member or someone they've loved that has passed away from cancer or whose life has been ever forever changed by cancer. And so to me on a on a deep human level that's not a promise that you throw around lightly or flippantly given how deep of a problem this is and how deeply this affects everyone's lives. So that was also a motivation to really break this down. And something I noted in accompanying these promises was being quite light on specifics of actually how the technology will solve this. Um, and I don't know if you've seen many years ago the South Park episode of the Underpants Gnomes. Um, and this is kind of, okay, this [laughter] is this is how I I kind of see the super intelligence cancer curing promises and and that is is a sketch where they're going to learn about corporate development and and corporate takeovers and they encounter these underpants gnomes and they have three phases to their development process, which is phase one is to collect underpants. Phase two nobody knows in the whole group. Phase three is profit, right? And that's kind of how I see the super intelligence argument. It's like phase one, develop super intelligence. Phase two, shrug, nobody knows, something's going to happen. Phase three, cure cancer, solve climate change, universal education. And so, a big part of this is actually breaking down what would phase 2 actually look like if we were serious about that? How do we bridge this promise with reality? >> Yeah. I guess the underlying assumption if if I'm sort of naively sketching it out here, it looks something like uh with sufficient intelligence we could cure cancer and so we need to develop super intelligence and that will allow us somehow to cure cancer. We don't know how because we are not smart enough but a super intelligence would be smart enough. Now that is an assumption you question throughout the essay. tell us about whether intelligence is the actual bottleneck to curing cancer. >> Yes. So there's many reasons I don't believe intelligence is the key bottleneck to curing cancer, but I would start with the fact that we have a lot of sort of counterfactual examples already of we have a lot more intelligence now than when we did start tackling cancer and modern medicine in the 1950s. When that quest started, the doubling rate of medical knowledge was about 50 years. Now it's down to 73 days. Right? So, we've greatly accelerated our ability to get knowledge about biology and what's happening. And remarkably, with a few exceptions here and there for certain types of blood cancers and other cancers, mortality hasn't really moved all that much. And we haven't seen that exponential growth in understanding of biology correspond to new therapies being approved. The number of FDA drugs we've seen approved is pretty flat actually over over the decades. And we also know that we have we hear about geniuses in a data center. We have a over supply of human geniuses in biology. So there's actually far more scientists that are trained than we have available resourced environments and materials for them actually to run experiments and to learn things. We also know that there's drugs that showed really promising therapeutic benefit potentially for cancers um across the pipeline that just never made it through the FDA. Right? There are therapies we have that show promise for cancer that never made it for different business reasons, for different intellectual property reasons. Um, and so this idea that the growth of knowledge, the growth of understanding has an equal sign to actually cures getting to patients just has not been proven out by the knowledge gains that we have gotten so far from medicine. And I think in general grand challenges just don't tend to be data sort of intelligence limited problems right there are problems around data their problems around incentives their problems around coordination and I think AI getting smarter and smarter is going to have tremendous gains in fields that are first principles-based. So we look at the gains that increasing intelligence is having in math, in physics, in these areas where we understand the fundamental rules of the game and applying more and more intelligence to that can unlock breakthroughs that we couldn't imagine or we haven't thought of yet. But for biology, it doesn't have first principles, right? It's a series of emergent properties across scales. And we haven't actually measured biology enough to have a data set that we could actually train this intelligence for future intelligence on. So I do think that is another fallacy that comes up is saying AI is going to accelerate science and medicine and physics and math are all put in the same bucket. I think we need to disentangle that a little bit is where there's first principles increasing AI capabilities are going to have increasing gains but when there's not that that feedback loop breaks down. >> So so one thing you often hear is that there's a bunch of data in biology and and data is exactly what we need to train models to actually solve problems. So I is it the case that we're sort of drowning in data and does this does this mean that there's an untapped potential here like there was with language models where we had all this internet data and we could suddenly uh sort of having having them mimic a human language and and and thought um is there a lot of bi biological data. >> Yeah. [snorts] So that that I think is one of the biggest misconceptions around biology. I think people see that there's all of these journals, there's all of this work happening. So therefore, we must have tons of biological data that would be great to train uh this this model with. We get medical records. Our doctors take all these notes. Like isn't there the data out there to train what we need and get feed it to the AI to help deliver insights? Now, there's a number of problems with that. Starting sort of at the basic level and moving up. So at the basic science level, there's actually very little data that is in a format or accessible to being trained by AI. So most lab experiments that are done, that data is never actually brought into the public commons or into any sort of standardized even private database, right? It's siloed in academic institutions or within pharmaceutical companies. um if it is captured electronically at all. There's still many actual um leading academic institutions that are still have paper lab notebooks and don't actually have mandatory electronic capture of experiments and data. Second, when you're capturing experiment experimental data, you're not capturing all the tacet knowledge and everything that's being observed. You're you're cap capturing actually a very small portion of what it is that that you're measuring. Secondly, even if we were capturing all of that data, that data isn't necessarily comparable, right? We actually need to understand how do we measure a protein level in one experiment is different actually than a protein level in another experiment because of the different conditions that were used, formulas that were used, types of reagents that were used. So even if we had the data, it's not necessarily comparable data. The next piece of this is even if we don't have the data, we have the literature. That's what people say. We can train it off the literature and the insights. Well, we know actually that likely 60 to 70% of the literature is wrong, right? And we know this from the reproducibility crisis when scientists try and replicate the findings of a paper and most of the time they're actually not able to do that. Uh it's a bit like the marketing phrase which is half of it works, we don't know what half. That is the same for the medical literature. Half of it probably works, we don't know which half. [gasps] Then we get up to the humans, right? There's a lot of data maybe at the cellular level and at maybe some mouse level data, right? That is is pretty ubiquitous. We do a terrible job of actually measuring human biology and that data just does not exist really anywhere. People say, "Well, we have medical records. The medical records and the lab tests we've gotten that that will actually help unlock that." What people don't know is medical records are not actually designed to be data capture systems that reflect your clinical reality and your health. What they were designed for is to optimize and facilitate billing for medical institutions. And so the data they care about is the data that is rel relevant for issuing claims to insurance companies. And so as a result of that, there is a systematic bias in all of the data to make you look a little bit more sick than you do in order to increase revenue. And we saw this fail with the original IBM Watson experiment. So this was the original AI that played Jeopardy. Everyone loved it. It was probably the first AI that entered the public zitgeist. And they it went into a bunch of partnerships with the different medical institutions, Mayo Clinic, X, Y, and Z. And those partnerships ultimately failed for this reason, right? Training on electronic medical record data actually does not help in terms of predicting performance in the clinic and being generalizable to the clinic. >> [snorts] >> The lab tests that we have, those are great, but those are very coarse measurements of biology. You know, you think about going to the doctor, you get your annual exam, you get back like 35 blood tests, right? Or somewhere between that. Maybe if you're doing like the full battery and going deep and you're paying for some sort of personalized medicine service, you get to 135. And that's just a very very coarse measurement of everything that is happening with inside human physiology. And we do have new measurement modalities coming online that are much more precise like proteomics, metabolomics that can measure thousands of things in one's blood and imaging and full body MRIs that's not being really integrated into routine care or being captured at scale in any meaningful way. And so we end up effectively with this kind of data desert both from the basic biology standpoint all the way up to clinical biology. And I think that's a travesty because we do have other examples of what happens when we do have good data with AI. And the example I lean into here quite heavily is what happened with Alphafold. An alpha fold is for those who don't know is a system that was developed by deep mind to solve the protein folding problem. This was a problem that stumped scientists for decades. And this was an incredible medical breakthrough for being able to design new drugs and understand how to unlock new targets that we weren't be able to before because we didn't have full understanding of protein structures. This even won the Nobel Prize and I think very often this gets held up is an example of AI advances but from my perspective as much as it's an AI story it's also a data story and what protein folding had was this database called the protein datab bank and it was over decades scientists collectively around the world put in these X-ray crystalallography structures or basically the data of the known structures of the proteins that we've been able to capture and measure into a standardized database. So when we wanted to go tackle this problem of how do we solve protein folding there was actually a data set of here are all the structures of proteins that we know that is curated and scientifically validated. And so to me, that's kind of the counterfactual of if we want to start unlocking AI progress, we probably should start repopulating this data desert because if we do, we've seen that it can do really great things. >> And so we don't have anything of comparable sort of complexity and and size in terms of of data sets when it comes to to cancer. We don't have anything like the the the database for we used to to solve protein folding. We do have certain cancer registries and there are definitely efforts in this regard from the National Cancer Institute and others and those need to sort of be radically scaled up of like tumor profiles and how do we compare different tumor profiles and patient outcomes and I would say of the medical specialties cancer is probably the most outfront on this and trying to actually tackle this problem [gasps] but at a systemic level we really don't have that. It's a it's a fraction of patients that actually make it into those data sets and those data sets are also quite focused, right? It's what is the tumor biology. It's not what's the whole patient story and context around this, right? Uh I think the data set that is probably one of the more interesting ones that starts to solve this is the work that has been done with the UK biioank. So, this was an effort that was started decades ago by the UK government to basically follow 500,000 people over decades and use every state-of-the-art measurement technique that came online, the imaging, the proteomics, the everything and see what their health outcomes look like and just measure the population over time. And so those are probably the examples the patients within that data set that went on to develop cancer of of where we have like the best longitudinal data and pictures of patients. So there are efforts to try and close this gap but they are woefully sort of small and underresourced and insufficient relative to the problem at hand. >> Yeah. Yeah. I think it's worth spending a little time on just the complexity of cancer. It's it's almost misleading to talk about cancer as one disease as you you might tell us why that is. Um so yeah tell us tell us about how complex cancer is and perhaps tell us about elephants, naked mole rats and bowhead whales or bowhead whales. Yes, these are all wonderful, amazing creatures and what they have in common is um they very much have inspired scientists of are there examples in nature of mammals that live a decently long time and don't get cancer, right? And they all fall into this bucket. And in fact, nature has solved this problem, right? Nature has solved biology and saying what are ways we can engineer biology that confer a degree of cancer resilience. And so the idea here was like oh this is so great we have these examples in nature we'll go study them and they will reveal to us the way that we become cancer resistant and what that mechanism is. And then what scientists actually found is instead of giving us this panacea or this sort of universal cancer resilience mechanism, they kind of all developed cancer resilience through totally independent and distinct genetic pathways and had very different resilience phenotypes. So basically the way that they had their cancer resilience was entirely different between each species. And so that kind of dowsed our hopes that like, all right, there's not a universal mechanism here. And the way we get here is through a whole bunch of different strategies that were very much tailored to the biology and evolutionary processes of that particular organism. But in terms of human complexity, I think the best example of this is I highly recommend that everyone read uh Sedartha Mukerji's book, The Emperor of All Maladies. This is a great book that really leans into this. It's called a biography of cancer and leans into like the complexity of this and the fact that cancer is not a single disease, but it's actually like an evolutionary shadow of ourselves, right? It is a dynamic evolutionary process. I think in terms of the medical literature the best summation of this has been this series of papers called the hallmarks of cancer. And so this started in the year 2000 where scientists put together like what is cancer? What are the hallmarks of things that we see in the disease processes that could be things we target to actually stop cancer or cure cancer. And it started with six original hallmarks and then there was a revision in 2011 and then again in 2022. And what has happened is as we've learned more about biology and we realized, oh, it's not just the tumor, it's also the immune system. It's the environment around the tumor. It's the fact that it's very adaptive and heterogeneous. Okay, we have these microbes that live with us. They actually play a role in this as well. And the story of understanding cancer has just revealed an ever growing layers of complexity and ever growing layers of individuality and how those pathways go wrong. So the same way in our naked mole rats and our elephants, right, we have different pathways of how things go right. Even between individuals, we have different ways that things go wrong. And we see this in the evolution of how we treat cancer. Like we started treating cancer based on organs, right? You had breast cancer, you had colon cancer and you would remove the tumor and you do some chemotherapy and radiation which is carpet bombs the body and that was the way of thinking of treating it. And then we started to understand the mutations in each tumor, right? This was a big sort of finding in sort of the late 90s and genomics coming online. And then we started to say, well, can we target different mutations in those cancers? And so instead of treating cancers by sort of their area their lo tumor is located, now drugs are getting approved based on well what are the mutations within that cancer that we want to target. And the story has been ever and ever more individualized biology in terms of like what what pathways are going wrong. And that's to the level that even within an individual tumor in someone's body, there's different mutations in different cancer cells. And it's called like tumor heterogeneity. So even within one tumor, different bi biological pathways are going wrong in different parts of the tumor. So it really is something that's not just like a static disease process or a single mechanism that needs to be treated. It is a series of many mechanisms and mechanisms that are adaptive and evolving and pushing back. And so so you have the complexity of the biology itself and then you have the complexity of the medical system that's trying to intervene on that biology. So maybe tell us about what happened in South Korea with the thyroid screening program. >> Yeah. So one of the attempting thing to say is like well we know if we catch cancer early it has a better treatment prognosis. So why don't we just catch all cancers really early and like figure out how we detect every cancer cell that goes wrong in the body? And there's a problem with this because many of us are we make sort of protoc right we always have cells that are making mutations that could be potentially come cancerous but our other biological sort of homeostatic mechanisms keep that in check and keep that from happening. There's also many people that die with cancer but not from cancer, right? Where there's cancerous tumors that sort of come up in our body, but it grows into a small tumor and it's never going to spread and it's actually never going to kill you. And so there was this really interesting screening study that was done in South Korea which was looking at ultrasounds of the thyroid to basically say, can we detect thyroid cancer? And when they sort of implemented a screening program nationwide, they had about had a 15-fold increase in the diagnosis of thyroid cancer, yet you actually didn't see really many any changes in the mortality of thyroid cancer, right? And so what you ended up doing was detecting a lot of cancers that were small tumors that were actually unlikely to cause problems. And from a public health perspective, you're putting patients through treatment with risks to it and side effects to it without necessarily any benefit. And so there is this paradox that like early detection is maybe not always the best way to find a good risk benefit ratio in the long run. And so it's more of a question of like how do we identify the cancers that cause problems not necessarily like how do we define alla like find all cancers and this is coming really into focus with new efforts that are like this sort of multi-cancer early detection which is blood tests for cancer right can I have a blood test that detects some cancer DNA and so we're really trying to figure out and there's largecale clinical trials ongoing to understand is that on the right side of things where we actually are going to pick up things early and be able to treat them and prevent deaths or are we going to actually end up in the South Korea case where we're mostly picking up things that aren't going to cause problems and people end up getting treatments that they don't need. So even the idea like it's seductive to think oh we should just catch everything but catching everything might not always be the best thing to do. Mhm. So what we're describing here is cancer as as a massively complex problem. I think we could we one response here could be well if it's so complex doesn't that strengthen the case for us needing super intelligence to solve it. Isn't it the case then that we are not smart enough? We we can't process enough data to actually sort of understand this problem and and and solve it. >> Yes. I I think that is a seductive idea. Um I think we start with the problem. Problem number one is the super intelligence cannot model something that does not have first first principles and does not have data. Right? So even if we were to have super intelligence tomorrow, we hit up against this problem. And I think it's really worth breaking down like why that's actually a problem and like why biology is different than physics. So like okay super intelligent it's so smart right it's so good at computing let's compute human biology and figure this all out and I think it's worth breaking that down that like human bodies we have 30 trillion cells right and each of these cells have an amount immense amount of intercellular machinery physics x y and z so if you really wanted to say let's take physics and how do we go from physics to actually computing biology I have done sort of uh cosmology consult on this one to actually figure out what that means in terms of compute and basically simulating just a single week of one human being's biology. If we covered our whole Earth, all of the Earth in GPUs, we're running them at their thermodynamic limit. How much time are we going to need to compute that biology? That's going to look like something like the age of the universe. And that's starting from classical physics and not quantum physics. So the idea here is like the idea we can compute biology from physics is just computationally infeasible. Even if we had quantum computers, if it like it doesn't matter how much in order to power that super intelligence brain to do this activity, we just it's it's it's an impossible task. And so when you don't have physics available to you, you kind of need to turn to the data piece of things, right? Um there is >> before we get to the data um is it so there's sort of the limit case where what we would need to simulate is the entirety of the biology of a functioning human for one week. What about simulating one cell? What about simulating something something much smaller or something that where we're making simplifications all over the place? Isn't that an an interesting project? Isn't that a project that might give us something useful at least? >> Yes. So, I am super bullish on the idea of virtual cells. I think those are going to be really amazing for biology and they're going to be really amazing for figuring out how can we screen a bunch of hypotheses at once in a cellular environment and look at cellular perturbations and see what happens. the problem with and and so that I don't want to demean that effort because that is going to be transformative for biology and our ability to hypothesis test at scale within the in vitro environment that doesn't necessarily have predictive value for humans. So there are lots of things we know work in cells. Treatments for cancer, they work in cells. They even cure mice, right? As we go up the thing, like if you are a mouse, we know how to cure your cancer at this point in time. Like it is a very good time to be a mouse. I often joke about that that like maybe we are in the hitchhiker's guide to the galaxy because any disease you have, we can pretty much cure it in a mouse at this point. Um but that has a very low predictive value for humans. So like 97% or 90% higher of those things that work in cells and work in mice ultimately fail to move the needle in humans. And so understanding the cell a lot better is going to help us give get a lot more leads to bring into the process. But we still need to figure out how do we actually bridge that process and get a better predictive value, better connect what happens in the cell to understanding how that relates and and predicts whether or not something's actually going to treat a human. If for those that are like interested in this topic, I highly recommend reading Steven Wolram's writings on biology and his sort of theory of computational irreducibility. And he's someone that has really been doing a lot of work in understanding you know there are some systems that you just have to model right you actually can't get there from first principles and how could we actually start tackling that in biology to start figuring out some of these rules um so that is something I really you know recommend folks read if that like deep diving into that is of interest I think the other piece of where the cell problem goes wrong is just the fundamental emergent properties across scales right so what's happening at the cell layer is different That's what's happening at the tissue layer, then at the organ layer, then at the systems layer, then at the whole body layer. And each of those layers of biology have emergent properties that are not necessarily accessible to the layers above or below them readily. And so what happens there is until we can start to understand the emergent properties across scale. So the virtual cell is one but then like how do we stimulate simulate the interactions between multiple cells that form tissues that form organs that form humans. That will be the work that we need to do in order to really better bridge that gap between cell human and the predictive value between the two. >> Yeah. And and so if we can't solve or if AI cannot solve the problem of cancer by by finding the first principles of biology because those perhaps do not exist then there's there's the there's the alternative path of having enough data. Now we've discussed some of some problems with getting enough data but do you want to say more about whether we will get there when how long it might take for us to have enough data uh to really sort of begin to be able to model cancer? >> Yes. So I think the conversation around data in biology and in the clinic starts with the conversation around measurement. I think those two go handinand. So there's the data which is the product of the measurement interacting with this thing you would like to measure, right? And I think there has been a ton of progress that has been made in our ability to measure biology and innovating in our ability to measure biology from looking at sort of what's happening within a single cell to even at the clinical level, right? Being able to now take a blood sample and know what's happening in thousands of proteins at once to be able to do whole body imaging and have high resolution of the structural components of the human body. Uh to be able to measure the the micro diversity that's in our bodies and interacts with disease. To be able to measure the heterogeneity of the immune system and the thousands of components there that regulate and sort of translate in between the systems that we have. the work that's happening to map the brain, right, and the conneto. And so there are these efforts that are sort of nassent efforts to better measure sort of human biology at all scales. They're just massively underresourced because I it's sort of the problem of the public commons, right? like everybody wants the data but actually investing in how we develop new measurement techniques and apply those measurement techniques to generate the data sets we need it's just it doesn't have a it's not commercially viable there's not a lot of interest in that and then there's also the piece of motivating people to be involved in that and I think there's a step before the like how do we model cancer to like what is cancer anyway right and this bigger question of like what is health? What is disease? Is something we don't have an answer to because we've never really truly measured individual variation in biology. Like what is a healthy amount of individual variation that's in spec and what is things that are out of spec and start to cause disease, right? That's also gets to the problem of like what tumors cause problems, what tumors don't, right? And so until we have an understanding of like what does health look like that is also how we need to get to what does disease look like and we have classifications of disease that we use but relative to what we're talking about with AI and data sets like those are coarse words that just describe a set of observations and feelings and symptoms that probably actually mean a thousand different things. So Alzheimer's disease is probably used as a bucket term to describe the observation of what is a whole bunch of distinct pathways. And we don't know how many. We don't know what those look like because we haven't really looked, right? And so we're so indoctrinated into the way we've thought about classifying disease and taking that as truth instead of saying, well, let's like that was the 1950s, right? When we were using words to describe things. How do we actually start describing things in terms of bi individual biology and the measurement of that biology? That's a kind of phase transition that needs to happen if we're going to get that data um [clears throat] from real humans in the clinic in everyday life at scale. And at scale is what you really need to be able to move the needle on AI modeling of it. And I guess our values also begin to uh intrude into this conversation about what health is just because there are various trade-offs you can make. So for example, there's a trade-off between longevity and size if I understand things correctly. So if you if you become really bulky, if you become very muscular, maybe you don't live as long. And so what do you what do you want out of life? What what does it mean to be healthy? There's a trade-off again as I understand it between fertility and sort of vital if you if you understand me correctly that's not a medical term but like um again you can take certain drugs that that make you bigger but perhaps causes you to to be not as as fertile. And so there are there are values and trade-offs in the conversation about what health is. I think >> completely and I think you're hitting on something really important here which is biology is a homeostatic system right and I joke that like there's no free lunch in biology and that's something many scientists say because when you perturb biology you're fundamentally perturbing a whole bunch of pathways and it's unforeseen sort of what else is going to happen at the most basic level this is why medications have side effects right we design the medication to intervene in this disease process or to hit this target and whoops, we had all these unforeseen things happen. And this is why we still need clinical trials is we actually cannot predict at scale what are all those other things that can start happening in terms of the trade-offs that you're making. And this is a fundamental cultural difference, I think, between the way that big tech and AI scientists think and the way that clinicians and biologists think. So the culture of Silicon Valley and big tech has been one where narrow optimization leads to success. And so you pick a metric, you drive that metric really, really hard, you achieve scale, you achieve ska escape velocity, and you make change happen and you bring something new into the world. In biology, you cannot do that, right? And I'll take give you the example of like lipids in your blood. So lipids in your blood. Well, if you drove that down to zero, your brain wouldn't work. And if you drove that all the way up, your arteries would start clogging, right? And so, like, everything exists in these sort of narrow homeostatic windows. And I think the question is is we don't even know what those windows are. And that comes down to the question of like what is health and what is disease is understanding like in all of us human beings and all of our individual biologies what is that window that is truly representative of homeostasis and then what is that window where you start to get out of bounds and that's actually going to cause some sort of disease. Um, so, so I think that is like a key piece here too of realizing that biology is just fundamentally a homeostatic balanced process and pulling one lever is going to trigger other levers that you might not even perhaps know about. And that's a process of the fact that this is an evol like an evolved system and not an engineered one, right? Like evolution has built in a tremendous amount of redundancy into the systems. that actually evol like actively resists rapid change, right? And so like cancer is actually an example of what rapid change looks like and I've seen this narrow optimization to your point of like longer lived animals and thing in like the longevity world. So longevity world okay how do we live longer? How do we actually like increase the number of healthy years we have? I think there's a lot we can make happen in that area of saying like okay where are there fundamental mechanisms to all these age related diseases can we treat those can we develop therapies for those but then there's other folks who approach it and say no no no we're going to get radical life extension and the way we're going to do that is by turning back the clock and we're going to just there's a clock and our ability to age and we're just going to turn that back and then it's going to stay at that new set point and we're going to live forever. The problem with that again asterisk is that all of our cells are on different clocks, right? We know like for example in women in biology the ovaries age at a much higher accelerated rate than other tissues in the body. All of our cells are on different clocks. And so when you start turning back a clock, you start getting cells that can divide more and proliferate more. And actually if you go too far, that's what cancer looks like, right? And it it's quite funny of how these two things uh collide because one of the number one shortcomings to all of the efforts to date that have tried to turn back the clock is you end up with tumor formation. And actually cancer cell looks a lot like a daged cell, right? And so it is kind of a interesting thing in biology that like anytime you start really trying to do radical interventions, you tend to end up with radical side effects. And so we have not yet figured out how to do kind of one without the other. >> Yeah. Yeah. So we we've laid out the complexity of of biology and we've laid out how intelligence is not necessarily the main bottleneck here and and how there are many other bottlenecks. Now as an insight in this system, how would you say AI fits into the drug development pipeline? Where does it help us and and where doesn't it help us? >> Yeah. So this is one of the areas that I am super kind of excited about is like AI throughout the drug development pipeline and like what does that actually mean in being able to remove friction and accelerate things and sort of my vision of like where do we go is can we actually compress the time it takes to tra to test a drug to be equal with that of the duration of the biological process we're trying to understand and so like if a disease takes 5 years to actually have an end point how do we collapse that so our whole process is down to like the 5 years or close to asmmptoic to that actual biological process and AI is making a lot of gains here and I think this is a point that goes really overshadowed by the ASI story I think there's a lot of oxygen in the room kind of being taken out by ASI and sort of folks claiming like the builders of Frontier AI are the builders in the room and we are the people that are going to solve the problem and it obscures the fact that there's so many AI scientists, entrepreneurs, folks in pharma that have already developed AI tools and are actually unlocking the benefits that AI has to offer and like doing that hard work to actually use AI to solve health and disease. Like that's actually already happening. We don't need to wait for the future. It's like going on in the here and now. And I think we're seeing that like just to name a few modalities like in being able to identify better drug targets with AI in being able to do things called computational toxicology which is basically you use look at the molecule and use AI to predict how likely is this going to be toxic based on the toxicity profiles we know of all other drugs that are out there. How is it going to enable us to discover new biomarkers, right? Like what are things we can look at, right? In for example a disease like Alzheimer's disease that takes 10 years, 12 years to actually get to a result, what are things we could look at that are in the blood or indicative of maybe if something's working earlier on or moving the needle on the disease state, right? So AI is being applied at that level. It's helping us, you know, better design clinical trials and like who are the right patients for the trial. Do we actually still need a control group or can we just do a synthetic data control group, right, where we simulate what the null outcome would be and then compare the results to that? So there's so much happening here with AI and like actually accelerating and removing friction from the drug development process to try and compress it. And this is happening in big pharma. There's all AI teams there that are actually developing all in models to use in house. This is happening in startups. This is even happening in academia. And so I think that is like a really important story to celebrate is like the role that AI is actually already playing in making this process go better faster and unlocking what it actually has to offer. I often hear stories from medical researchers about how much time they feel like they have to spend on sort of processes on interacting with bureaucracy on filling out paperwork and so on. So there's how AI might be able to help on the actual biology and then you tell me is there also a story of how AI might help us speed up some of these processes so we can spend the the valuable time of of the scientists on on solving the actual problems. >> Yeah. So I see tremendous potential again in the here and now sitting on the shelf that we're actually not pursuing or developing for AI to help with both the removal of bureaucracy in the scientific process as well as the removal of bureaucracy within the healthcare delivery process, right? Because a drug is only actually good if it is approved and gets to a patient, right? And actually saves that life patient's life or makes that patient better. And we know that our process of going from insight in a lab to delivered to a patient is a deeply bureaucratic process at each step of the way in terms of the amount of paperwork that's required, but also in terms of like navigating gatekeepers at each set uh each step of the way and navigating misaligned incentives each step of the way. So I think at least how I think about it is in the scientific process sort of the first gatekeeper you encounter is in academia which is like what is the overton window of thought like what are our fundamental assumptions about how biology works or doesn't work or how diseases work or doesn't work and if your idea is within that box you're likely to get an NIH grant or you're likely to get supported right if your idea is out of that box you're really going to struggle for resources right and so we have a system that fundamentally rewards incremental thinking and not necessarily rewards out of the box thinking. So like step one is like how can we actually use AI systems to encourage reward change peerreview processes think about alternate ways we can evaluate ideas to value the out of the box ideas just as much as the inside of the box ones to get more of those going. Then you have sort of the the next gatekeeper which you encounter. Okay, you have an idea. You tested it in your your your cells, in your lab, your mouse. He looks good. You want to take that to the FDA and because you want to say like, okay, does this work in humans at this point? Well, you just don't need the research. You need the research done in a way that's compliant with all the laws and all the paperwork and all of that, regulatory filings. Like, that's an easy job for AI. like AI can just automate all that and make that happen and bring the cost of that down and allow smaller companies and academic institutions to actually go see the FDA. Well, then you need to get go back to the FDA because each step in the clinical trials, you have to go talk to them until you like get your approval. And even in that place, the data capture of clinical trials, designing clinical trials, the decentralized clinical trials, AI can really help with all of that and expedite that. Take the bureaucracy out. Okay, great. We got our FDA approved drug. Now we're ready to go. Actually, we're not. We have a few more gatekeepers that we need to encounter. The next one is payers, right? And like who's going to pay for this? Our insurance company's going to cover this new drug. How do you navigate those those conversations with the insurance company? That is going to be something that I think AI is going to be great at. AI is going to be really good at figuring out like how do I get this new drug approved for this patient and covered for this patient and like empowering patients to actually a be able to interact in a meaningful way with these insurance companies that have been super cost prohibitive and kind of a radical outside the box piece of bureaucracy. Do we actually even need insurance companies that have human beings there? Right? This is all formulaic work. um could we have an AI native insurance company that can cover a lot more care for patients at a fraction of the cost because it doesn't have the overhead of employees, right? Um then we get to the doctor, right? Is the doctor next gatekeeper? Is he going to prescribe this for you or not? I think there's other ways that AI is fundamentally changing the asymmetries of information, empowering patients to learn what's available for them to go in there and not have this doctor knows best attitude, but actually have be empowered and be able to access like what is the state-of-the-art, right? This person I mean love clinicians, but like your medical knowledge is not happening at the rate of clinical progress, right? like what you learned in medical school and in your training is very outdated relative to how fast things are moving within biomedical progress and so it is much more of a collaborative environment now than a doctor knows best environment. So I do think across all levels there like there is tremendous potential we already have to make health care cheaper bureaucracy leaner and get treatments to patients faster. How would you sort of summarize the history of the FDA? Because it seems to me that that at one point the FDA was was really necessary to sort of fix the the wild west situation that was going on in medicine and perhaps then at some point uh lessons were learned and perhaps overlearned and now we we have a system that is that is not flexible enough. um in in in one second in your piece you write about how there are certain drugs Viagra GLP1s that that couldn't really be approved today if uh yeah tell us about that. Yeah. So, the FDA in its original embodiment was there to deal with this wild west that existed as you allude to beforehand where people are like pedalling cures for cancer that are some radioactive compound or some toxic compound, right? >> Literal literal snake oil, right? >> Literal snake oil. Quite literally. Like I think people don't realize that like the term snake oil was a literal actual thing. People sold snake oil as a as a potential treatment for everything, right? It was one of those panaceas back in the day. This is good for everything. And so in order to make sense of this, because people were dying because there were toxic ingredients in these things. People said we need to understand the safety of these products like what is the safety of that? And the first sort of iteration of the FDA was in terms of safety. Then over the years it became well we need safety and efficacy right because we can't actually understand safety and isolation unless we actually understand how effective it is because there's always side effects. And over the years there sort of became more and more requirements of what you had to demonstrate. And from the perspective of wanting to make sure something is safe and effective that is understandable as to why that regulatory process sort of unfolded. What I think is not seen is the cost of taking that process. And again like as an agency whose job it is to me sort of weigh risks and benefits, we also have to like do a meta weighing of the risks and benefits of like what has happened from those regulatory decisions. And what we've ended up with is a system that mandates uh sort of I mandates under a level of understanding that is not actually what medicine or science can have to offer. Right? So we have you can only have a drug approved if it meets a certain disease category. Well, these disease categories were established decades ago. Right? And now we understand that like some of those disease categories are too broad. Some are too narrow, right? And like you might actually have a clinical trial where you do a study and in that disease category 30% of patients do amazing and 70% of patients don't actually get any benefit. Well, you look at that and you start to understand, well, these 30% of people who did really well were of a specific subtype, right? And that was what was driving their doing well. that drug is actually may not make it through the FDA because the clinical endpoint was just developed for everybody and it doesn't acknowledge that like there's going to be different groups that do well or or less well within it. Um, you know, we think of the FDA's understanding of rational drug design where you have to go to them and tell them like this drug has this target, this mechanism to treat this disease. And it is a very like onetoone process like one target, one mechanism, one disease. That's really not our understanding of biology anymore. That's a very outdated understanding. And as we think about, you know, the individualization of biology and like if we truly want personalized medicine, we're going to have to be able to figure out not just the one thing that works in someone, but what are the multiple like the group the cocktail of things that can work in someone? And the like beauty of cocktails is something we saw in the HIV case, right? We knew it wasn't one drug that was able to help bring in HIV. It was a triple therapy, right? you needed three things together to make that happen. That is probably true of many diseases that if you actually put 1 plus 1, you get three for that particular individual or that particular sort of disease subclass. But right now, that's not something you can really have the flexibility to kind of take to the FDA and mixing and matching and figuring out what does that do to help someone and then understanding the mechanisms. So the point you laid out there is things like Viagra, lithium, the GLP1s. Um what we've actually found is some of these drugs are kind of grandfathered in before the days where it was mandated that we have this very rational onetoone like target mechanism disease kind of framework where we actually don't know how lithium works, right? We're still using it today. And if you ask like what's the mechanism of action, valproic acid is another one that like we don't know. We just don't know. We know it's effective, but we actually do not know what the specific target is, what the specific mechanism there. We look at things like Viagra, right? One of the most bestselling drugs of all time. Rogain for hair growth is another one. Both of those drugs were blood pressure medications. And in the during the clinical trial based on observed side effects like oh my god this works so much better for other things right like let's pivot it and like let's follow that indication that was a scientific observation tells you like I don't know the mechanism here but I know that it's working and interestingly like even the GLP-1 drugs which is like the most recent craze when these drugs were being developed the original thought was like oh this is going to work through delayed gastric emptying which is the idea that it's going to take le more time for your stomach to empty and therefore you'll eat less and things. And then we actually discovered well yes it does that but probably the main mechanism is acting on the brain right and that's why it's becoming a therapy for even things we didn't think of like addiction um right that are moving beyond food and into other categories. So all of those ideas and observations just happen to make it through loopholes or happen to be grandfathered in but are actually not readily accessible in the existing system. So there's a whole bunch of combination therapies, clinical observation based therapies even you know how do we start studying whether foods work, whether supplements work, whether these other ideas work. Well, you can't because of the bureaucracy involved in the FDA process is expensive and there's no commercial model to do that. So, I do think there is a need to kind of rethink this the structure of the FDA to bring it kind of up to 21st century science. To their credit, they're trying that like there's a lot of FDA modernization efforts that are happening. It's just hard, right, when you have a system that entrenched and also a system where there are sincere questions about like how much of changing regulation or deregulating or opening up investigation is actually to benefit fit corporate interests as opposed to patient interests. So like how do you actually have that modernization discussion in a way that builds trusts and you know makes people feel like this is really to better advance science and not just to better advance corporate interests. >> Yeah. You you mentioned speeding up uh clinical trials or compressing the time it takes to conduct a clinical trial. And I guess the the limit case there is something like the trials for approving the COVID 19 vaccines. Those were, as I understand it, much faster than previous vaccine trials, like an order of magnitude faster. Is that is that can we get to that place when it comes to approving potential treatments for for cancer? >> Yeah. So, the COVID vaccine is become kind of the poster child of like how quick can we get a drug approved, but I think again like asterisks, there's you really need to break down what actually happened with CO. And so we know that okay it was approved in something like 10 11 months isn't that amazing can't we get drug approvals down to that what that story neglected to tell was Madna was founded in 2010 right like there was already over a decade of like work on this fundamental scientific platform of generating the pre-clinical data the safety data the like basic proof of concept of the safety of this approach and the scientific ific validity of the approach that kind of had already been done. So that like first 10 years of homework had already been done by the time that CO co hit. Um what's interesting about CO is CO is a really easy clinical trial to run. When you have a pandemic sweeping through your population that pretty much anyone who engages in society is going to get, it is not hard to recruit clinical trial participants, right? like I'm going to run a trial. I need to find people who are going to want to participate. Recruiting for COVID is just a highly motivated general population. It's not I have a rare cancer and there's only a thousand of us on the planet or I have a disease and I don't that I'm going to get in 10 years and don't even know that I have it is a much more difficult thing to potentially recruit for. The third part of it is that the time between clinical trial enrollment and outcome is very easy when you're in the midst of a pandemic and with an infectious disease, right? Like in an infectious disease, you're dealing with a time to event that goes between infection and when you are able to detect the virus or you're detect symptoms and that would for co was like 5 to 10 days, right? So within 5 to 10 days, you pretty much knew like did this person have the is this vaccine protective or not? It's a very quick study to run. There were even folks that were and this was something that was totally ethically defensible during the COVID pandemic that wanted to do challenge trials, which is this idea that like I'm going to get infected anyway being in the population. why don't I just go into a clinical study, get the vaccine, and then intentionally try and infect me um and and see whether or not that the vaccine works. So, that compresses it really again that idea of like how do we get clinical trial processes down to the biological limits like that biological limit is in like the 5 to 10 day area. Now, that is totally different than talking about something like Alzheimer's disease, right? where your time to end point, your time to get a result, the time to know if something's working is 10, 11 years, right? In some of these cases, 5 to 10 years. And we see this quite a bit in cancer. And this is something that's really worth highlighting is a lot of the cancer therapies that we see approved are for late stage cancers. Now, part of that is because it's more ethically sort of defensible to experiment in later stage cancers when people have failed treatments, but it's also like cynically easier trial to run because your time to end point, which is does this extend life, is much is short. That is very different than where we actually need to be testing cancer therapies, which does this work in early stage disease or does this prevent disease. And so when you start getting to those questions, your timelines become so much longer, right, in prevention studies or in early stage studies. And that's something that's just as of right now is not fundamentally compressible. And so I think there's a little bit of intellectual dishonesty in saying that the COVID example is reflective of what's available to all chronic and complex diseases. The last piece of it is the resourcing of it. Like there were unprecedented amount of resources that went into getting the COVID vaccine done from the government, from the regulatorators that were on board of like how can we make this go as quickly as possible. That doesn't exist for chronic diseases. Like cancer is killing 600,000 people in America every year and it commanded kind of nothing close to the amount of resources that we invested in COVID. So like dollars do make it go faster and it's a question of like how do we actually want to all lot those resources and in cancer we do a lot resources but it's still a fraction of healthcare expenditures and a fraction of what we invested in co >> yeah I I want to end with us talking about what we can do if we if we don't sort of hang our hopes on us developing super intelligence and that somehow curing cancer what is it then we can do and we've begun to to describe this regulatory reform form uh different places in the in the drug development pipeline where AI might be able to help. And I want to I want you to to tell us about the overall picture here. What does current cancer actually look like if it doesn't look like super intelligence just sort of emerging and then suddenly solving the problem? >> Yeah. So I would I would say there's a few ways to think about this. I would say step one in AI and curing cancer or just curing cancer period, right? Without thinking about the role of AI, step one is doubling down on these AI tools that can reduce friction in the process, increase predictive value, make things go faster. There are numerous ones across every dimension from identifying new drugs to AI in proteomics, AI in genomics, AI in clinical trial designs, AI to better select therapies for patients in the clinic. All of that we need to be doubling down on and amplifying and celebrating like those companies and work should be celebrated at the same level as we are our sort of big tech friends developing their their LLMs and resourced, right? And I think the resourcing is a really important piece here and this is where the ASI promise does actually have costs beyond the narrative costs and beyond the staking our hopes on the future which is it's consuming an unprecedented amount of capital right it is sucking up all the capital in the room because it is very expensive to train these models in an like in an unprecedented way and in a world where there is a finite amount of private dollars available for investment and a finite amount of dollars in VC funds. Fundamentally, that's money that is being diverted away from these AI tool companies, biotech research, cancer companies, and into ASI. And we know that there's not, you know, it's a reasonable assumption, but you can look at the correlation of the amount of money going into AI and the fact that biotech is at a 10-year low in its investment cycles, and companies are really competing to actually get capital to resource some of these breakthrough ideas, tools, and technologies. Um, so how do we get them more money to do the good work that they're they're doing on the AI side? Also, how do we get more money, attention, resources to all of these promising areas in oncology, right? Like the bread and butter of biomedical research, like there are areas we know have a lot of promise and just need more resources, more engagement to be able to push them across the finish line. So, that's kind of the second piece is like how do we celebrate resource promising areas with within oncology. And then the last piece is we've been talking about is how do we restructure incentives? How do we restructure institutions to make all of this current efforts and future efforts go better and faster and reward the right things? So there's the data piece of this which we've talked about data and measurement. How do we s get serious about new models to enable the creation of largecale data sets? Now, this could look like the NIH moving away from [clears throat] investing in individual researchers to saying like the NIH is going to devote a whole bunch of dollars to actually developing big bold data sets that we need. We think about the role philanthropy has played in this. This is something that was part of the UK bioank story was philanthropy coming in like the same way that we have naming rights for buildings on academic institutions, can we do that for data, right? Can we have philanthropists buy and name um a particular data set that is needed in the community and forever gets quoted in the scientific literature in under their name? Right? So getting creative about ways that we can better sort of resource data collection. How can we also change the conversation around better measuring patients and collecting that data from patients? And that's both a piece to of regulatory reform to allow us to use these new state-of-the-art measurement modalities to measure patients and work with them to figure out how that actually could integrate into clinical care. It's also a matter of empowering people to know that these things exist and getting them down to price points very much like happened with consumer genomics where like the original genome super expensive like now it was down to a price point that actually consumers could afford how do we do that across areas of novel biological measurement so that's accessible I would say the other piece is what data what sort of research do we fund and reward how do we move from this incre incremental model to a high-risisk highreward model. This is kind of the field of meta science that I highly recommend folks look at that. This is something Derek Thompson's written about in his book abundance and other essays. Uh but how do we translate more to a sort of ARPAH I think is the good example within the government. This is the health version of DARPA, which is basically like how do we make big bold bets on high-risisk, highreward research, like let's resource that, let's do more of that. Let's figure out how we can get more high-risk research uh funded and those outside of the box ideas funded. I think there's simple fixes like let's just mandate anything that's federally funded gets electronic data capture, right? like the stuff we're already doing, let's make sure we write it down and get it into a format that can actually be used on the data side. I think on the more institutional side of things and an underappreciated piece of where the combination of collecting data and AI can be really transformative is this idea of outcomes linked reimbursement and moving from a system that basically pays this fee for service idea like the more health care you deliver, the more things you do for a patient, the more you keep them chronically sick, the more money you Right. And it says, "Let's try a new system." And this has been talked about for a very long time, but I think we're getting to the moment where the technology tools exist to actually make it happen, which is an outcomesbased model. You get paid based on whether a person's healthy or not, right? Whether a person gets better or not. And we haven't yet had the data to actually make that determination, right? And switch to that kind of model of payment. I think that the combination of data and AI will really be able to kind of make that happen. >> So what I'm hearing from you is that we need to make concrete progress on a bunch of different domains and this is in a position to sort of staking our hopes on one technology swooping in and solving everything um again in in a sort of ambiguous way. >> Yeah. I mean this is an all hands on deck every sort of piece of the biomed infrastructure. How do we make it go better? How do we identify the bottlenecks, solutions to those bottlenecks and get those implemented with the kind of urgency that we actually need to get those implemented with and and I would say there is the China element here and the China counterfactual. Um, so an interesting example of what it looks like to go allin on AI tools throughout the both the drug discovery process, development process and clinical process is very much we can look at what's happening in China right now. So, China has taken very much an AI tools first approach to deploying AI in society and it's been quite interesting to see the amount of progress China has made within biotechnology and within the biomedical world. So they used to be thought of as like oh China is where you know knockoff drugs happen and where you go to develop you know develop things quickly or test things out right that is a very outdated hypothesis and I think AI's had a quite a big role in this where now a lot of the early stage new molecules and big pharma deals are actually coming out of China and original research that is being done there and I think that's in no small part to the acceleration they've experienced because of the implementation of AI tools and actually really working with that on the application layer. >> Great. It's been great chatting with you Amelia and and for listeners who are interested in this conversation, I will link the essay in this in the description of this podcast. Thank you.