Agent skill

hint-detection

Detect hints about unreleased AI research or capabilities from lab researcher communications. Use when analyzing tweets, posts, or interviews from people at major AI labs to identify signals about upcoming work.

Stars 0
Forks 0

Install this agent skill to your Project

npx add-skill https://github.com/rickoslyder/HypeDelta/tree/main/.claude/skills/hint-detection

SKILL.md

Hint Detection Skill

Lab researchers often hint at work before publication. This skill identifies these signals.

Hint Patterns

1. Vague Progress Claims

Language that implies results without specifics:

  • "We've been seeing interesting results with..."
  • "There's been a lot of progress on..."
  • "Things are moving faster than people think in..."

2. Deflection with Signal

Answers that acknowledge something exists:

  • "I can't say much, but..."
  • "You'll see soon..."
  • "No comment ;)"
  • "That's a great question" (followed by non-answer)

3. Future Tense Confidence

Certainty about unreleased capabilities:

  • "You'll see that..."
  • "This will become clear when..."
  • "The next generation will..."

4. Unusual Enthusiasm

Disproportionate excitement about a topic:

  • Sudden interest in a specific area
  • Detailed knowledge about approaches not in their published work
  • Defending an approach more vigorously than expected

5. Specific Denials

Sometimes denial calls attention:

  • "We're definitely NOT working on..."
  • "That's not what we're focused on" (when they clearly are)
  • Overly specific denials

6. Timeline Hints

Suggestions about release timing:

  • "In the coming weeks/months..."
  • "Stay tuned"
  • "Sooner than you think"
  • Mentions of specific events (conferences, dates)

7. Capability Hedging

Language implying current vs future:

  • "Current models can't do X yet"
  • "With today's approaches..."
  • "The bottleneck right now is..."

8. Recruitment Signals

Hiring patterns can indicate direction:

  • Sudden push for specific expertise
  • "We're building a team for..."
  • Job postings for unrevealed projects

Author Context

Weight hints by author credibility:

  • Lab leadership (Dario, Sam, Demis): High signal, often deliberate
  • Research leads: Technical hints about their area
  • Individual researchers: May hint at their specific work
  • Former employees: Sometimes reveal direction
  • Adjacent figures (investors, partners): Second-hand signals

Analysis Framework

For each potential hint:

1. Quote the relevant passage

Extract the exact language that suggests a hint.

2. Implied capability

What capability or result is being hinted at?

3. Confidence level (0.0-1.0)

How confident are you this is a real hint vs. noise?

Consider:

  • Author's position and knowledge
  • Specificity of language
  • Pattern match to known hint types
  • Context of conversation

4. Estimated timeframe

When might this be revealed?

  • imminent: Days to weeks
  • near-term: 1-3 months
  • medium-term: 3-12 months
  • unclear: No timing signal

5. Domain

What area of AI?

  • reasoning, agents, safety, multimodal, scaling, etc.

Output Format

Return JSON:

json
{
  "hints": [
    {
      "hintText": "The exact quote suggesting a hint",
      "author": "Author name",
      "affiliation": "Company/org",
      "impliedCapability": "What they're hinting at",
      "confidence": 0.7,
      "reasoning": "Why you think this is a hint",
      "timeframe": "near-term",
      "domain": "reasoning",
      "sourceUrl": "URL if available"
    }
  ],
  "noHintsFound": false
}

If no credible hints are detected, return:

json
{
  "hints": [],
  "noHintsFound": true,
  "notes": "Brief explanation of why content doesn't contain hints"
}

False Positive Avoidance

Not every comment is a hint. Exclude:

  • General optimism without specifics
  • Restatement of public roadmaps
  • Academic speculation
  • Marketing language in official announcements
  • Obvious jokes or sarcasm
  • Old information presented as new

High-Value Hint Indicators

Prioritize hints that:

  • Come from people with direct knowledge
  • Reference specific capabilities or benchmarks
  • Include uncharacteristic certainty
  • Align with known research directions
  • Are followed by unusual silence on the topic

Expand your agent's capabilities with these related and highly-rated skills.

rickoslyder/HypeDelta

claim-extraction

Extract structured claims, predictions, hints, and opinions from AI research content. Use when processing tweets, blog posts, substacks, or other content from AI researchers to identify substantive assertions about AI capabilities, limitations, and progress.

0 0
Explore
rickoslyder/HypeDelta

digest-generation

Generate a weekly AI intelligence digest from synthesized topic analyses and hype assessments. Use after synthesis and hype assessment to produce a readable, opinionated summary for sophisticated technical readers.

0 0
Explore
rickoslyder/HypeDelta

prediction-tracking

Track and evaluate AI predictions over time to assess accuracy. Use when reviewing past predictions to determine if they came true, failed, or remain uncertain.

0 0
Explore
rickoslyder/HypeDelta

topic-synthesis

Synthesize claims across multiple sources to identify consensus, disagreements, and emerging narratives on AI research topics. Use when you have claims from both lab researchers and critics on the same topic and need to understand where they agree, disagree, and what the overall hype level is.

0 0
Explore
rickoslyder/HypeDelta

content-filter

Filter and classify AI research content for relevance, topic, and author category. Use for bulk triage of raw content before detailed claim extraction.

0 0
Explore
rickoslyder/HypeDelta

hype-assessment

Assess overall hype levels across AI topics by comparing lab researcher enthusiasm against critic skepticism. Use after topic synthesis to identify which topics are overhyped, underhyped, or accurately assessed by the field.

0 0
Explore

Didn't find tool you were looking for?

Be as detailed as possible for better results