|
GenAI Software Engineer (LLM/Indexing)
Role: GenAI Software Engineer (LLM/Indexing)
Location: San Francisco, CA(onsite) Contract Role JOB DESCRIPTION: Software Engineer (RAG/LLM) Lam Research is seeking a highly skilled and experienced Software Engineer to join our team. The ideal candidate will focus on enhancing our information retrieval and generation capabilities, with specific experience in Azure AI Search, data processing for RAG, multimodal data integration, and familiarity with Azure Services. In this role, you will build a robust indexing framework that transforms unstructured, semi-structured, and structured data for consumption by GenAI applications. This framework will ensure seamless integration and accessibility of data, which will be consumed by an LLM-based chatbot (but not limited to) to optimize and enhance semiconductor manufacturing processes. Key Responsibilities: • Framework Development: Play a key role in developing a foundational indexing framework to accelerate the onboarding of Lam Strategic Data Assets. • Multimodal Data Integration: Integrate and manage various data types (e.g., text, images, videos) to enhance retrieval and generation capabilities. • Cross-functional Collaboration: Work closely with cross-functional teams to support data integration into our data retrieval ecosystem, ensuring seamless functionality and performance. • Scalability and Reliability: Ensure the scalability, reliability, and performance of data retrieval in production environments. • Data Security: Ensure robust data security measures are in place to protect access to sensitive information. • Automation: Develop and implement automation strategies to streamline data onboarding and processing workflows. • Performance Monitoring: Monitor and analyze the performance of data pipelines and retrieval systems, making necessary adjustments to optimize efficiency. • Innovation: Stay updated with the latest advancements in AI to drive innovation and maintain a competitive edge. What we're looking for: • Bachelors degree in Computer Science, Data Science, or a related field. • A Masters degree in Data Science or a related field is preferred. • Approximately 8 years of experience, primarily in software engineering with some experience in developing ETL pipelines. • Proficiency in Python and FastAPI • Proven experience in software development, with an emphasis on building and deploying RAG pipelines or similar information retrieval systems. • Familiarity with processing multimodal data (e.g., text, images) for retrieval and generation tasks. • Strong understanding of database systems (both SQL and NoSQL) and data warehousing solutions. • Proficiency in Azure AI, Databricks, and other relevant tools and technologies. • Experience with Azure Services, including Azure Durable Functions and Azure Kubernetes. • Excellent problem-solving skills and the ability to work both independently and collaboratively in a team environment. • Strong communication skills to effectively convey technical concepts to non-technical stakeholders. Nice to have: • Experience working in a fast-paced environment, demonstrating adaptability, innovation, and the ability to thrive in dynamic settings. • Experience with Generative AI (GenAI), including large language model (LLM) orchestration and evaluation. • Experience with Helm charts for managing Kubernetes applications, including the ability to define, install, and upgrade complex Kubernetes applications using Helm.? Azure AI & machine learning, Azure Databricks, CMS, MLOps, Microsoft Azure, Microsoft Azure AI Search, Microsoft Azure Databricks, NoSQL database, Python, RAG,SQL, artificial intelligence, business intelligence, cloud computing, cloud providers, communication, computer science, content management, content repository, data analysis, data collection, data engineering, data management, data processing, data querying, data science, data science solutions, data warehouse, database, digital communication, generative AI, information technology, machine learning, mathematics, programming, prompt engineering, science & research, search engines, software development, software engineering, statistics, technology Gabriela Cirin External Resource Manager (ERM) SubCo Staffing Center/ Procurement Capgemini Guatemala | Guatemala | ||||||