Designing and Implementing a Resilient Deep Learning Framework

Foundation models across various domains are experiencing rapid growth, necessitating continuous expansion to enhance performance. However, training these Large Language Models (LLMs) not only demands significant resources but also relies on a robust and dependable system to ensure an effective training process.<br /> <br /> Algorithm engineers face numerous challenges when training realistic LLMs, including server crashes, hardware failures, software compatibility issues, network communication errors, and unknown hangs. These failures result in the loss of training output and necessitate multiple restarts, consuming extra time and resources. For instance, launching the training process for a 175B model in a distributed environment requires several hours, occupying a substantial portion of the total training stage, which many researchers find financially burdensome.<br /> <br /> Therefore, establishing a robust and dependable platform to support the entire lifecycle of LLM development is not only complex and challenging but also urgently required.<br /> The project aims to explore and develop a resilient deep learning framework, investigating its scientific foundation, to enhance the LLM development lifecycle, with a specific focus on failover perspectives. The system is designed to tolerate any worker's crash or failure without impacting its overall execution. The automatic failover process, transparent to upper-level users, efficiently restarts and re-initializes failed workers based on soft or hard states. Given the novelty of this research, students are encouraged and supported to publish ground-breaking papers at top-tier conferences and even explore technical patents for potential startups.<br />

<p>To apply for this project you will need to make a formal application for research degree study through the <a href="https://www.leeds.ac.uk/research-applying/doc/applying-research-degrees">University website</a>. You will need to create a login ID with a username and PIN. </p> <p>•    For <strong>Application type</strong> please select <strong>Research Degrees – Research Postgraduate</strong>. <br /> •    The admission year for this project is <strong>2026/27</strong> Academic Year. <br /> •    You will need to select your <strong>Planned Course of Study</strong> from a drop-down menu. For this project, scroll down and select <strong>PHP Computer Science Full Time.</strong> <br /> •    The project start date for this project is <strong>1 October 2026</strong>, please use this as your <strong>Proposed Start Date of Research</strong>. <br /> •    Please state clearly in the<strong> Research Information Section</strong> that the research degree you wish to be considered for is <strong>Designing and Implementing a Resilient Deep Learning Framework</strong> as well as <a href="https://eps.leeds.ac.uk/computing/staff/331/professor-jie-xu">Professor Jie Xu</a> as your proposed supervisor.</p> <p><strong>Please state clearly in the Finance section</strong>, <strong>the funding that you are applying for, if you are self-funding or externally sponsored</strong>.</p> <p>More information on how to apply is available on our website <a href="https://www.leeds.ac.uk/research-applying/doc/applying-research-degrees">here</a>. You will be required to provide a personal statement which outlines your interest in the project you are applying for, why you have chosen it and how your skills map onto the requirements of the project.</p> <p>We will assess applications continuously as we receive them. We welcome and strongly encourage any potential applicants to contact the supervisor(s) for an informal discussion, prior to applying, and recommend submitting your application early.</p> <p><strong>If you are applying for University or School Scholarships for 2026/27 entry, with external sponsorship or you are funding your own study, please ensure you provide your supporting documents at the point you submit your application:</strong></p> <ul> <li>Full Transcripts of all degree study or if in final year of study, full transcripts to date including the grading scheme</li> <li>Personal Statement outlining your interest in the project</li> <li>CV</li> </ul> <p>If English is not your first language, you must provide evidence that you meet the University's minimum English language requirements (below).</p> <p><em>As an international research-intensive university, we welcome students from all walks of life and from across the world. We foster an inclusive environment where all can flourish and prosper, and we are proud of our strong commitment to student education. Across all Faculties we are dedicated to diversifying our community and we welcome the unique contributions that individuals can bring, and particularly encourage applications from, but not limited to Black, Asian, people who belong to a minority ethnic community, people who identify as LGBT+ and people with disabilities. Applicants will always be selected based on merit and ability.</em></p>

Applicants to research degree programmes should normally have at least a first class or an upper second class British Bachelors Honours degree (or equivalent) in an appropriate discipline. The criteria for entry for some research degrees may be higher, for example, several faculties, also require a Masters degree. Applicants are advised to check with the relevant School prior to making an application. Applicants who are uncertain about the requirements for a particular research degree are advised to contact the School or Graduate School prior to making an application.

The minimum English language entry requirement for research postgraduate research study is an IELTS of 6.5 overall with at least 6.5 in writing and at least 6.0 in reading, listening and speaking or equivalent. The test must be dated within two years of the start date of the course in order to be valid. Some schools and faculties have a higher requirement.

<p><strong>Self-Funded or externally sponsored students are welcome to apply.</strong></p> <p><strong>Scholarship opportunities open from October 2025</strong></p> <p><strong>UK</strong> – The <a href="https://phd.leeds.ac.uk/funding/209-leeds-doctoral-scholarships-2024">Leeds Doctoral Scholarship</a> <strong>(closing date: 1 April 2026)</strong> and <a href="https://phd.leeds.ac.uk/funding/234-leeds-opportunity-research-scholarship-2022">Leeds Opportunity Research Scholarship</a> <strong>(closing date: 1 April 2026)</strong> are available to UK applicants.  <a href="https://phd.leeds.ac.uk/funding/60-alumni-bursary">Alumni Bursary</a> is available to graduates of the University of Leeds.</p> <p><strong>Non-UK</strong> – The <a href="https://phd.leeds.ac.uk/funding/48-china-scholarship-council-university-of-leeds-scholarships-2021">China Scholarship Council - University of Leeds Scholarship</a> is available to nationals of China <strong>(Now closed for October 2026 entry)</strong>. The <a href="https://phd.leeds.ac.uk/funding/73-leeds-marshall-scholarship">Leeds Marshall Scholarship</a> is available to support US citizens. <a href="https://phd.leeds.ac.uk/funding/60-alumni-bursary">Alumni Bursary</a> is available to graduates of the University of Leeds.</p> <p>Please note that if you are successful in securing an academic offer for PhD study, this does not mean that you have been successful in securing an offer of funding.</p> <p>If you are applying for the Leeds Doctoral Scholarship or the Leeds Opportunity Research Scholarship, you will need to complete a separate application, specific to these scholarships, to be considered for funding.</p> <p>You will be responsible for paying the overtime fee in full in your writing up/overtime year (£340 in Session 2025/26), but the scholarship maintenance allowance will continue to be paid for up to 6 months in the final year of award.</p> <p><strong>Eligibility Criteria</strong></p> <ul> <li>Applications are open to either International or Home (UK) applicants.</li> </ul> <p>Please refer to the <a href="https://www.ukcisa.org.uk/">UKCISA</a> website or our <a href="https://www.leeds.ac.uk/undergraduate-fees/doc/fee-assessment">fee assessment page</a> for information regarding Fee Status for Non-UK Nationals.</p> <p><strong>Important: Please be aware that any expenses related to the relocation of international students to the UK (<a href="https://www.leeds.ac.uk/international-visas-immigration/doc/applying-student-visa">visa, Immigration Health Surcharge</a>, flights, etc) would be their responsibility and is not covered by this award</strong></p> <p><strong>Other Conditions</strong></p> <ul> <li>Candidates who have previously been awarded a PhD or are currently registered on a PhD are excluded from applying. Those who were previously studying for a PhD but did not complete may be considered. </li> <li>Awards must be taken up by 1st October 2026.</li> <li>Applicants must live within a reasonable distance of the University of Leeds whilst in receipt of this scholarship.</li> </ul>

<p style="margin-bottom:11px">For further information about this project, please contact Professor Jie Xu by email to <a href="mailto:J.Xu@leeds.ac.uk">J.Xu@leeds.ac.uk</a></p> <p>For further information about your application, please contact PGR Admissions by email to <a href="mailto:phd@engineering.leeds.ac.uk">phd@engineering.leeds.ac.uk</a></p>