|
Sr. Engineer, Prompt Engineering
Role name: Sr. Engineer, Prompt Engineering
Location can be Atlanta, Bellevue, WA or Dallas TX Contract Role Role and responsibilities: • 5+ years of experience in AI/ML and Data Scientist roles. • Extensive experience with Azure cloud platforms and Databricks. • Extensive experience in Python, PySaprk • Extensive experience in building Generative AI applications using LLMs like Open AI, Gemini, etc • Extensive experience in Prompt Engineering • Experience with ML Frameworks • Strong understanding of statistical modeling, NLP, and deep learning. • Excellent problem-solving and communication skills. • Good Experience in MLOps and model lifecycle management. • Version control (Git) and CI/CD pipelines. Create, test, and refine prompts for various use cases (chatbots, content generation, summarization, reasoning, code generation). • Apply systematic prompt-engineering techniques such as few-shot learning, chain-of-thought, and instruction-tuning. • Build reusable prompt libraries and templates. • Define evaluation metrics for prompt quality (accuracy, relevance, safety, tone). • Conduct A/B testing and iterative improvement based on results. • Monitor prompt performance in production to detect degradation or bias. • Collaborate with developers to integrate prompts into applications, APIs, and pipelines. • Build tools to automate testing, scoring, and deployment of prompt configurations. • Work with MLOps/LLMOps teams to ensure version control and traceability. • Stay up-to-date with advancements in LLMs, prompt strategies, and retrieval-augmented generation (RAG). • Experiment with new techniques (e.g., function calling, context window optimization, multi-step reasoning). • Contribute to internal knowledge sharing and best-practice guidelines. • Ensure prompts meet privacy, compliance, and ethical AI standards. • Proactively identify and mitigate risks like bias, hallucinations, or unsafe outputs. • Partner with cross-functional teams (AI researchers, UX, product managers) to align on requirements. • Mentor junior engineers on prompt-engineering methodologies and safe AI practices. | ||||||