Engineer, Senior Staff

Company:

Job Area:

General Summary:

Job Overview:

The Qualcomm Cloud AI team is developing hardware and software for Machine Learning solutions spanning the data center, edge, infrastructure, automotive market. We are seekingambitious, bright, and innovative engineers with experience in machine learning framework development.Job activities span the whole product life cycle from early design to commercial deployment. The environment is fast-paced and requires cross-functional interaction daily so good communication, planning and execution skills are a must.

We are seekinga highly skilled and motivated Language Model Engineer to join our team. The primary role of the engineer will be to train Large Language Models (LLMs) from scratch and fine-tune existing LLMs on various datasets using state-of-the-arttechniques.

Responsibilities:

Model architecture optimizations: optimizelatest LLM and GenAImodel architectures for NPUs, which involves reimplementing basic building blocks of models for NPUs

Model Training and Fine-tuning: Fine-tunepre-trained models on specific tasks or datasets to improve performance. Implement state-of-the-artLLM training techniques such as Reinforcement Learning from Human Feedback (RLHF), ZeRO(Zero Redundancy Optimizer), Speculative Sampling, and other speculative techniques.

Data Management: Handle large datasets effectively. Ensure data quality and integrity. Implement data cleaning and preprocessing techniques.Hands-on with EDA is a plus.

Model Evaluation: Evaluate model performance using appropriate metrics. Understand the trade-offs between different evaluation metrics.

LLM metrics: Sound understanding of various LLM metrics like MMLU, Rouge, BLEU, Perplexity etc.

AWQ: Understanding of Quantization is a plus. Knowledge onQAT will be a plus.

Research and Development: Stay up to datewith the latest research in NLP and LLMs. Implement state-of-the-arttechniques and contribute to research efforts.

Infrastructure development : For coming up withnew optimization techniques to minimize ONNXmemory footprint, export time optimizations.

Collaboration: Work closely with other teams to understand requirements and implement solutions.

Required Skills and Experience:

Deep Learning Frameworks: Hands-on experience with PyTorchat a granular level. Familiarity with tensor operations, automatic differentiation, and GPU acceleration in PyTorch.

NLP and LLMs: Strong understanding of Natural Language Processing (NLP) and experience working with LLMs.

Programming: Proficiencyin Python and experience with software development best practices.

Data Handling: Experience working with large datasets. Familiarity with data version control tools is a plus.

Education: A degree in Computer Science, Machine Learning, AI, or related field. Advanced degree is a plus.

Communication: Excellent written and verbal communication skills.

Work experience : Open, 4 - 10 yearsof relevant experience.

Preferred Skills:

Exp - 9+ to 12 years

Optimization: Knowledge of optimization techniques for training large models.

Neural Architecture Search (NAS): Experience with NAS techniques for optimizingmodel architectures is a plus.

Hands-on experience with CUDA, CUDNNand Triton-langis a plus

Minimum Qualifications:

OR

Master's degree in Engineering, Information Systems, Computer Science, or related field and 5+ years of Software Engineering or related work experience.

OR

PhD in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering or related work experience.

• 3+ years of work experience with Programming Language such as C, C++, Java, Python, etc.

Applicants: Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail [email protected] or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.

To all Staffing and Recruiting Agencies:Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.

If you would like more information about this role, please contact Qualcomm Careers.