Medical Vision-Language Models

Vision language models (VLM) can process both visual information and natural language and learn associations between visual information and corresponding text descriptions. With their ability to extract semantics and insights from multi-modal data, they have shown impressive capabilities in tasks such as image captioning, visual question-answering, and text-to-image search. However, such models have seen limited adoption within real-world healthcare applications. Visual Question Answering (VQA) is a task that involves understanding and answering questions about images. It combines both computer vision, which interprets the content of images, and natural language processing, which deals with understanding and generating human language. The answers to these questions require an understanding of the image, the language, and domain-specific knowledge.<br /> <br /> Medical visual question answering models can assist clinicians in clinical decision-making and increase efficiency in the clinical workflow. They can be used to develop text-to-image search engines that allow users to query an image and its visual contents through natural language, making it possible to find medical images that fit specific criteria for research, discovery, or educational purposes.

<p>In this project, we aim to develop advanced computer vision and image understanding techniques to extract meaningful semantic information from medical images. We will utilize domain-specific fine-tuned language models for visual question-answering, showcasing the potential of vision-language models in clinical settings. Additionally, we will investigate open research challenges in this field, such as enhancing medical image understanding, leveraging language for weak supervision, pre-training foundational models, training vision-language models on medical datasets, and aligning image-text representations.</p> <p>A good knowledge of fundamental topics in computer vision, machine learning and deep learning, along with strong coding skills in Python is expected. Experience with natural language processing and generative deep learning is not necessary but preferred.</p> <p>The project will allow exploration of different ideas and topics, and a chance to work with collaborators from different disciplines.</p> <p>*Open to all nationalities <br /> *Applications - ongoing basis, closing date – current round: 31 October 2024 </p>

<p>Formal applications for research degree study should be made online through the <a href="https://www.leeds.ac.uk/research-applying/doc/applying-research-degrees">University's website</a>. Please state clearly in the Planned Course of Study section that you are applying for <strong><em>PHD Computer Science FT,</em></strong> in the research information section that the research degree you wish to be considered for is <em><strong>Medical Vision-Language Models for Visual Question Answering</strong></em> as well as <a href="https://eps.leeds.ac.uk/computing/staff/13320/dr-duygu-sarikaya">Dr Duygu Sarikaya</a> as your proposed supervisor.  <em><strong>Please state in the Finance section that the funding you are applying for is School of Computer Science Scholarship.</strong></em></p> <p>If English is not your first language, you must provide evidence that you meet the University's minimum English language requirements (below).</p> <p><em>As an international research-intensive university, we welcome students from all walks of life and from across the world. We foster an inclusive environment where all can flourish and prosper, and we are proud of our strong commitment to student education. Across all Faculties we are dedicated to diversifying our community and we welcome the unique contributions that individuals can bring, and particularly encourage applications from, but not limited to Black, Asian, people who belong to a minority ethnic community, people who identify as LGBT+ and people with disabilities. Applicants will always be selected based on merit and ability.</em></p> <p>Applications will be considered after the closing date.  Potential applicants are strongly encouraged to contact the supervisors for an informal discussion before making a formal application.  We also advise that you apply at the earliest opportunity as the application and selection process may close early, should we receive a sufficient number of applications or that a suitable candidate is appointed.</p> <p>Please note that you must provide the following documents in support of your application by the closing date of 31 October 2024:</p> <ul> <li>Full Transcripts of all degree study or if in final year of study, full transcripts to date</li> <li>Personal Statement outlining your interest in the project</li> <li>CV</li> </ul>

Applicants to research degree programmes should normally have at least a first class or an upper second class British Bachelors Honours degree (or equivalent) in an appropriate discipline. The criteria for entry for some research degrees may be higher, for example, several faculties, also require a Masters degree. Applicants are advised to check with the relevant School prior to making an application. Applicants who are uncertain about the requirements for a particular research degree are advised to contact the School or Graduate School prior to making an application.

The minimum English language entry requirement for research postgraduate research study is an IELTS of 6.5 overall with at least 6.5 in writing and at least 6.0 in reading, listening and speaking) or equivalent. The test must be dated within two years of the start date of the course in order to be valid. Some schools and faculties have a higher requirement.

<p class="MsoNoSpacing">A highly competitive School of Computer Science Studentship providing the award of full academic fees, together with a tax-free maintenance grant at the standard UKRI rate of £19,237 per year (in academic session 2024/25) for 3.5 years. There are no additional allowances for travel, research expenses, conference attendance or any other costs.</p> <p>You will be responsible for paying the overtime fee in full in your writing up/overtime year (£320 in Session 2024/25), but the scholarship maintenance allowance will continue to be paid for up to 6 months in the final year of award.</p> <p><strong>Important:</strong> Please note that that the award does not cover the costs associated with moving to the UK.  All such costs (<a href="https://www.leeds.ac.uk/international-visas-immigration/doc/applying-student-visa">visa, Immigration Health Surcharge</a>, flights etc) would have to be met by yourself, or you will need to find an alternative funding source. </p> <p>Please refer to the <a href="https://www.ukcisa.org.uk/">UKCISA</a> website for information regarding Fee Status for Non-UK Nationals.</p>

<p>For further information about this project, please contact Dr Duygu Sarikaya by email to <a href="mailto:D.Sarikaya@leeds.ac.uk">D.Sarikaya@leeds.ac.uk</a></p> <p>For further information about your application, please contact Doctoral College Admissions by email to <a href="mailto:phd@engineering.leeds.ac.uk">phd@engineering.leeds.ac.uk</a></p>