Orchestrates AI/ML engineering activities. Covers LLM APIs, embeddings, RAG systems, fine-tuning, and AI frameworks.
Agents
Agent
Purpose
faion-ml-agent
AI/ML implementation and integration
References
Detailed technical context for each area:
Reference
Content
Lines
openai-api.md
GPT-4, DALL-E, Whisper, Assistants
~1310
claude-api.md
Claude models, tool use, extended thinking
~1420
gemini-api.md
Gemini models, multimodal, grounding
~1150
embeddings.md
Text embeddings, similarity, chunking
~900
finetuning.md
Model fine-tuning, datasets, evaluation
~990
langchain.md
Chains, agents, memory, tools
~1440
llamaindex.md
Document indexing, query engines
~1210
vector-databases.md
Pinecone, Weaviate, Chroma, pgvector
~1390
Total: ~9,810 lines of technical reference
Quick Reference
LLM Provider Selection
Provider
Best For
Context
Cost
OpenAI
General purpose, vision, tools
128K
$$$
Claude
Long context, reasoning, safety
200K
$$$
Gemini
Multimodal, grounding, 2M context
2M
$$
Local (Ollama)
Privacy, no API costs
Varies
Free
Model Selection
Task
Recommended Model
Complex reasoning
Claude Opus 4.5, GPT-4o
Fast responses
Claude Sonnet 4, GPT-4o-mini
Code generation
Claude Sonnet 4, GPT-4o
Vision/Images
GPT-4o, Gemini Pro Vision
Embeddings
text-embedding-3-large, voyage-3
Fine-tuning
GPT-4o-mini, Claude (coming)
Framework Selection
Framework
Use Case
LangChain
Complex chains, agents, many integrations
LlamaIndex
Document indexing, RAG, structured data
Haystack
Production RAG, enterprise
Vercel AI SDK
Streaming UI, React integration
Vector Database Selection
Database
Best For
Pinecone
Managed, serverless, enterprise
Weaviate
Hybrid search, GraphQL
Chroma
Local dev, lightweight
pgvector
PostgreSQL integration
Qdrant
Performance, filtering
Methodologies (24)
LLM APIs (M-LLM-*)
ID
Name
Purpose
M-LLM-001
Prompt Engineering
Effective prompts, few-shot
M-LLM-002
Structured Output
JSON mode, function calling
M-LLM-003
Streaming Responses
Real-time output
M-LLM-004
Token Optimization
Context management, caching
M-LLM-005
Error Handling
Retries, fallbacks
M-LLM-006
Rate Limiting
Throttling, queuing
Embeddings (M-EMB-*)
ID
Name
Purpose
M-EMB-001
Chunking Strategies
Size, overlap, semantic
M-EMB-002
Similarity Search
Cosine, dot product
M-EMB-003
Hybrid Search
Vector + keyword
M-EMB-004
Reranking
Cross-encoder, Cohere
RAG (M-RAG-*)
ID
Name
Purpose
M-RAG-001
Document Processing
Parsing, extraction
M-RAG-002
Index Design
Hierarchical, knowledge graphs
M-RAG-003
Query Processing
Expansion, routing
M-RAG-004
Context Assembly
Ranking, filtering
M-RAG-005
Response Generation
Grounding, citations
M-RAG-006
Evaluation
Relevance, faithfulness
Fine-tuning (M-FT-*)
ID
Name
Purpose
M-FT-001
Dataset Preparation
Format, quality, size
M-FT-002
Training Configuration
Hyperparameters
M-FT-003
Evaluation Metrics
Loss, task-specific
M-FT-004
Deployment
Model serving, A/B testing
Agents (M-AGT-*)
ID
Name
Purpose
M-AGT-001
Tool Design
Function definitions
M-AGT-002
Agent Loop
ReAct, plan-and-execute
M-AGT-003
Memory Management
Short/long-term
M-AGT-004
Multi-Agent Systems
Orchestration
Workflows
RAG System Development
1. Document ingestion
- Parse documents
- Split into chunks
- Generate embeddings
2. Index creation
- Store in vector DB
- Add metadata
3. Query pipeline
- Embed query
- Retrieve relevant chunks
- Rerank results
4. Response generation
- Assemble context
- Generate response
- Add citations
Fine-tuning Pipeline
1. Data preparation
- Collect examples
- Format for model
- Split train/eval
2. Training
- Upload dataset
- Configure hyperparameters
- Start job
3. Evaluation
- Run on eval set
- Compare to base model
- Check for regressions
4. Deployment
- Deploy model
- Monitor performance
- Iterate
Code Patterns
OpenAI Chat Completion
python
from openai import OpenAI
client = OpenAI()
response = client.chat.completions.create(
model="gpt-4o",
messages=[
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Hello!"}
],
temperature=0.7,
max_tokens=1000
)
print(response.choices[0].message.content)