My Jarvis
Voice & chat
Hold the mic and speak, or type. Replies can be read aloud. German, English, French, Spanish, Italian, Turkish.
“Explain quantum computing”
Features
Twenty modules
Each one is optional. Whatever you don't configure is skipped at startup.
01 Conversation
Wake word & clap
“Hey Jarvis” starts recording hands-free. Or clap twice. Calibrates to your room noise.
“Hey Jarvis …”
Memory
Facts you hand over are kept encrypted and reused later. Deletable one by one.
“Remember that I prefer Python”
Proactive suggestions
Suggests the sensible next step: a briefing in the morning, a test after code, a recap at night.
Decision helper
Structured pros and cons ending in a clear recommendation, weighted by what it knows about you.
“Should I learn Python or Rust?”
02 Screen & system
Screen vision
A 5-second countdown, then a screenshot goes to the vision model. Live mode re-checks every 2–3 seconds and speaks up when something changes.
“Look at my screen”
PC control
Clicks, keystrokes and app launches, gated by a whitelist, a risk score and injection checks.
“Open Chrome and search for the weather”
Code processing
Python runs through py_compile, JavaScript through node --check. Syntax errors get up to three repair attempts, then formatting.
“Write a Python script for CSV import”
To-do execution
Hit START TO-DO and My Jarvis works the list top to bottom, ticking items off. It stops on a problem and waits for you.
03 Your day
Calendar
Reads Google Calendar and creates events from plain language.
“Create an event for Friday 2pm: team meeting”
Tasks
Todoist and Notion: list what's open, add new items.
“Add to Todoist: reply to email”
Fetches unread mail over IMAP, summarizes it, drafts replies. Nothing is sent without your confirmation.
“What's new in my inbox?”
Daily briefing
Weather, headlines, today's events and open tasks — on request or automatically at 08:00.
“Give me my briefing”
Deadline warnings
Info at 24 hours, amber at 1 hour, red with a sound at 15 minutes — from your calendar, tasks and conversations.
“This needs to be done by Friday”
04 Reading & writing
Documents
PDF with tables, Word, plus TXT, MD, CSV, JSON, XML and HTML. Long files are chunked automatically.
“Summarize report.pdf”
YouTube
Links are detected on their own. Transcript in, summary out — videos over 15 minutes in 5-minute chunks.
“Summarize this video: [link]”
Research
RSS feeds, arXiv papers and Hacker News top stories for your configured topics.
“What's new in research?”
Social posts
LinkedIn posts, X threads of 5–8 numbered tweets, newsletters. Rewritable in tone and length.
“Write a LinkedIn post about AI in healthcare”
05 Home & money
Smart home
Home Assistant or a Philips Hue bridge: lights, thermostat, media, plus a device overview.
“Set the temperature to 22 degrees”
Finance
Spoken expenses are categorized and logged. Monthly budgets warn at 80% and 100%.
“I spent 45 euros on groceries”
Always on: safety
Ctrl+Alt+J kills every running action. Risky commands ask first, dangerous ones are blocked, API keys stay encrypted.
Reference
What each integration needs
Everything goes into ~/.jarvis/config.json.
| Module | Needs |
|---|---|
| Calendar | google_credentials.json in ~/.jarvis/ — OAuth desktop client from the Google Cloud Console |
| Tasks | todoist_api_key, or notion_api_key + notion_database_id |
email_imap_server, email_address, email_app_password | |
| Smart home | ha_url + ha_token, or hue_bridge_ip |
| Research | research_topics — a list of arXiv search terms |
Optional packages
Missing one only disables that feature.
| Package | Unlocks |
|---|---|
pvporcupine | precise wake word detection |
google-api-python-client | Google Calendar |
dateparser | natural language dates |
todoist-api-python, notion-client | tasks |
feedparser | news in the briefing |
pdfplumber, python-docx | PDF and Word |
youtube-transcript-api | YouTube summaries |
black | Python formatting |