Pareto-Optimized Multimodal Reinforcement Learning for Radiological Decision Support Using MIMIC-CXR Chest Images and Clinical Reports
Research Pipeline
Medical Images + Clinical Reports → Multimodal Representation → Reinforcement Learning → Pareto Optimization → Decision Support
This research explores how an AI system can learn from both medical images and clinical text simultaneously. By combining computer vision (for processing chest X-ray images) and natural language processing (for interpreting clinical reports), the system develops a unified multimodal representation. A reinforcement learning agent then uses this representation to support complex radiological decision tasks. Pareto optimisation is applied to balance multiple competing objectives in the learning process — moving beyond single-metric optimisation towards more balanced and clinically meaningful outcomes. This is research-level work; no clinical deployment or medical claims are made.