Job Description:

This position requires office presence of a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered.

What You'll Do:

We are looking for a highly skilled Senior Software Engineer (LLM/Prompt-Context Engineer) with a strong full stack Python background to design, develop, and integrate intelligent systems focused on large language models (LLMs), prompt engineering, and advanced context management. In this role, you will play a critical part in architecting context-rich AI solutions, crafting effective prompts, and ensuring seamless agent interactions using frameworks like LangGraph.

What You'll Bring:

• Prompt & Context Engineering:
  Design, optimize, and evaluate prompts for LLMs to achieve precise, reliable, and contextually relevant outputs across a variety of use cases.
• Context Management:
  Architect and implement dynamic context management strategies, including session memory, retrieval-augmented generation, and user personalization, to enhance agent performance.
• LLM Integration:
  Integrate, fine-tune, and orchestrate LLMs within Python-based applications, leveraging APIs and custom pipelines for scalable deployment.
• LangGraph & Agent Flows:
  Build and manage complex conversational and agent workflows using the LangGraph framework to support multi-agent or multi-step solutions.
• Full stack Development:
  Develop robust backend services, APIs, and (optionally) front-end interfaces to enable end-to-end AI-powered applications.
• Collaboration:
  Work closely with product, data science, and engineering teams to define requirements, run prompt experiments, and iterate quickly on solutions.
• Evaluation & Optimization:
  Implement testing, monitoring, and evaluation pipelines to continuously improve prompt effectiveness and context handling.

What You'll Need:

• Deep experience with fullstack Python development (FastAPI, Flask, Django; SQL/NoSQL databases).
• Demonstrated expertise in prompt engineering for LLMs (e.g., OpenAI, Anthropic, open-source LLMs).
• Strong understanding of context engineering, including session management, vector search, and knowledge retrieval strategies.
• Hands-on experience integrating AI agents and LLMs into production systems.
• Proficient with conversational flow frameworks such as LangGraph.
• Familiarity with cloud infrastructure, containerization (Docker), and CI/CD practices.
• Solid understanding of PostgreSQL or other relational databases, including fundamentals of database design and querying.
• Exceptional analytical, problem-solving, and communication skills.

Preferred:

• Experience evaluating and fine-tuning LLMs or working with RAG architectures.
• Background in information retrieval, search, or knowledge management systems.
• Contributions to open-source LLM, agent, or prompt engineering projects.

Our Senior Software Engineers, earn between $116,700.00 - $196,100.00 USD Annual Not to mention all the other amazing rewards that working at AT&T offers. Individual starting salary within this range may depend on geography, experience, expertise, and education/training.  

Joining our team comes with amazing perks and benefits:

• Medical/Dental/Vision coverage  
• 401(k) plan  
• Tuition reimbursement program  
• Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)  
• Paid Parental Leave  
• Paid Caregiver Leave  
• Additional sick leave beyond what state and local law require may be available but is unprotected  
• Adoption Reimbursement  
• Disability Benefits (short term and long term)  
• Life and Accidental Death Insurance  
• Supplemental benefit programs: critical illness/accident hospital indemnity/group legal  
• Employee Assistance Programs (EAP)  
• Extensive employee wellness programs  
• Employee discounts up to 50% off on eligible AT&T mobility plans and accessories,
• AT&T internet (and fiber where available) and AT&T phone.

#LI-Onsite – Full-time office role-

Weekly Hours:

40

Time Type:

Regular

Location:

USA:GA:Alpharetta / 500 North Point Pkwy - Adm (Owned):500 North Point Pkwy

Salary Range:

$116,700.00 - $196,100.00

It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.

Job ID R-81901-2 Date posted 09/10/2025