After more than a decade, I’m still just trying to make my smart home act like J.A.R.V.I.S.


I’ve been tinkering with my smart home for well over a decade. My obsession began with trying to control my smart bulb with my voice. All these years later, I’m right back where I started.

The wake word that started my smart home obsession

Voice control was the gateway drug

Before smart speakers like Alexa brought the smart home to the masses, it was the preserve of tinkerers and geeks. It was way back in 2014 that I got my first smart home device, an off-brand smart bulb that I could control using an app on my phone. I soon realized that having to pull out my phone to interact with the light was far from ideal, and I wanted to find better ways to control it.

I discovered a community project online developed by a true legend who went by Michael C. It was software that ran on Windows (I was running it on Windows Vista) that would continually listen through a connected mic and use voice recognition to detect specific phrases. You could use these phrases to do things on Windows, such as open and read emails, open and close windows, play music, and more.

Crucially, it could also run shell commands. It was possible to use a shell command to send UDP packets to the smart bulb over my home network, which could turn the light on and off.

The magic came from using an Xbox Kinect sensor as the mic. This had a four-microphone array and beamforming that made it ideal for picking up my voice commands. You didn’t need to use a wake word as such, as the system was always listening, but some of the commands used the word “Jarvis” to make it feel like you were Tony Stark.

I graduated to more sophisticated systems

First openHAB, then Home Assistant

A Rasbperry Pi in an official Raspberry Pi case next to a Home Assistant sticker. Credit: Adam Davidson/How-To Geek

While this system was incredible, it was soon superseded. At the end of 2014, the first Amazon Echo was unveiled, and voice control went from being the domain of tinkerers to something anyone could access. By this point, I had a few more smart home devices, and I started looking for a better way to control them all.

I stumbled upon openHAB, an open-source smart home automation platform intended to let you control smart home devices regardless of their brand or smart home ecosystem. You can run it locally on relatively modest hardware and use it to control and automate your smart home.

I managed to set up some great stuff using openHAB. Using an IR blaster, I was able to control my TV using my voice, allowing me to change channels, turn up the volume, switch inputs, and more.

My initial smart home setup became quite a mess, and I wanted to rebuild it from scratch. I’d read about an alternative smart home automation platform called Home Assistant, so I decided to give that a try. I’ve been using it ever since.

Home Assistant Green

Dimensions (exterior)

4.41″L x 4.41″W x 1.26″H

Weight

12 Ounces

Home Assistant Green is a pre-built hub directly from the Home Assistant team. It’s a plug-and-play solution that comes with everything you need to set up Home Assistant in your home without needing to install the software yourself. 


For a long time, “Computer” was as close as I could get

Alexa offered limited wake word options

An Echo Show 5 on a kitchen windowsill. Credit: Adam Davidson / How-To Geek

Having moved away from Michael C’s Jarvis project, my voice control options were more limited. I’d bought some Echo smart speakers, and could connect them to my smart home devices and control them with my voice. Doing so required a wake word, and this worked better than the always-on system that I’d been using with the Kinect sensor, which could often mishear normal conversations as commands.

The options for wake words for Alexa are still very limited, however. I used the default “Alexa” initially, and switched to “Computer” as soon as that was an option so I could pretend I was Jean-Luc Picard.

Until reasonably recently, “Computer” has been the wake word I’ve been using. Annoyingly, the wake word detection for “Computer” doesn’t seem as good as “Alexa.” I’ve learned the hard way that the best way to get a response first time is to say “Computer” in a slightly ridiculous accent, which isn’t ideal.


Image of Amazon Echo Gen 4 speaker on desk.


7 Smart Home Devices I Wouldn’t Buy Again (and What I’d Get Instead)

Not every smart home purchasing decision turns out to be that smart.

A local smart speaker has brought me full circle

After more than a decade, I’m talking to J.A.R.V.I.S. again

The Seeed Studio reSpeaker Lite ESP32 development board on top of a speaker. Credit: Adam Davidson / How-To Geek

I finally got around to building my own local smart speaker that runs in Home Assistant using the native Assist voice assistant. It can run completely locally, and you can use predefined phrases to control your smart home, start timers, add things to your shopping list, and more. Assist comes with a few different pre-trained wake words, including “Okay Nabu,” and “Hey Mycroft.” Wouldn’t you know it, but one of the other options is “Hey Jarvis.”

I finally have my original wake word back, but this time things are very different. Using an LLM, I’ve been able to give my voice assistant the personality of an AI butler, and with a TTS service, I’ve also been able to give it a posh British voice. It really does feel like having my own version of Tony Stark’s AI assistant.


Smart home tinkering is often more about fun than utility

Automating your smart home can be very useful, but having come full circle, it reminds me that the biggest reason I mess around with this stuff is that it’s just a lot of fun. It has plenty of practical uses, but the journey is often even more fun than the destination.



Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews


The first computer my family owned was an 80286 IBM clone, and it had lots of ports, none of which looked the same. There was a big 5-pin DIN for the keyboard, a serial port, a parallel port, a game port for our joystick, and of course, the VGA port for the monitor.

In comparison, a modern computer has much less diversity in the port department. Not only are there fewer types of ports, but the total number may be quite low as well. When we move to modern laptops, it can be much more minimalist. Some laptops have just a single port on the entire machine! Is this a bad thing? As with anything, the extremes are rarely ideal, but I’d say overall, this has been a pretty positive development for PCs.

The port explosion era was never sustainable

It was more like a port infection

You see, the reason we had so many ports for so long is that people kept inventing new interfaces to make up for the shortcomings of existing ones. However, instead of the newer, better interfaces making the old ones obsolete, they just became additive as perfectly summarized in this classic XKCD comic.

A comic illustrates how competing standards multiply: first showing 14 competing standards, then people agreeing to create one universal standard, followed by a final panel showing there are now 15 competing standards. Credit: Randall Munroe (CC-BY-NC)

In laptops, the need for so many ports reached ridiculous heights. In this video posted by X user PC Philanthropy, you can see his Sager/Clevo D9T absolutely packed with all the trimmings leading to a rather massive laptop.

It is undeniably a cool machine, but obviously goes against the principle of portable computing. Also, every port you install means power and space that could have been taken up by something else. That’s true for laptops and desktops.



















Quiz
8 Questions · Test Your Knowledge

PC ports and motherboard I/O
Trivia challenge

Think you know your USB from your PCIe? Put your connector knowledge to the test.

PortsStandardsHardwareConnectorsMotherboards

Which USB connector type is fully reversible, meaning it can be plugged in either way?

Correct! USB Type-C features a symmetrical oval design that lets you insert it in either orientation. Introduced in 2014, it has become the dominant connector for modern devices and supports everything from data transfer to video output and fast charging.

Not quite — the answer is USB Type-C. The older USB Type-A connector (the flat rectangular one) famously required you to flip it at least twice before getting it right. USB Type-C’s reversible design was one of its biggest selling points when it launched in 2014.

What does the ‘x16’ in a PCIe x16 slot refer to?

Exactly right! PCIe x16 means the slot has 16 data lanes, allowing significantly more bandwidth than smaller x1 or x4 slots. This is why discrete graphics cards almost always use x16 slots — they need that extra throughput to feed pixel data to your display.

Not quite — the ‘x16’ refers to the number of data lanes. More lanes mean more simultaneous data paths between the CPU and the card. Graphics cards use x16 slots because their massive data demands require all 16 of those lanes working together.

Which port on a motherboard is most commonly used to connect a display directly to the CPU’s integrated graphics?

That’s correct! The HDMI and DisplayPort connectors found on a motherboard’s rear I/O panel are wired directly to the CPU’s integrated graphics unit. If you have a discrete GPU installed, you should use that card’s outputs instead for best performance.

The right answer is the HDMI or DisplayPort connectors on the rear I/O panel. These ports bypass the discrete GPU entirely and tap into the CPU’s built-in graphics. It’s a common troubleshooting trap — plugging a monitor into the motherboard instead of the GPU and wondering why nothing works.

What is the primary function of the 24-pin ATX connector on a motherboard?

Spot on! The 24-pin ATX connector is the main power connector that delivers multiple voltage rails — including 3.3V, 5V, and 12V — from the power supply to the motherboard. Without it seated properly, your PC simply won’t power on at all.

The correct answer is delivering power from the PSU to the motherboard. The 24-pin ATX connector is the big wide plug you’ll find on every modern motherboard. It supplies several different voltage levels that the board distributes to components. PCIe cards get their supplemental power from separate 6- or 8-pin connectors directly from the PSU.

Which of the following rear I/O ports transmits both audio and video in a single cable and is most commonly found on modern motherboards?

Correct! HDMI carries both high-definition audio and video over a single cable, making it one of the most convenient display connectors available. It became standard on motherboards as integrated graphics improved, and modern versions support 4K and even 8K resolutions.

The answer is HDMI. VGA is analog-only and carries no audio, DVI-D is digital video only without audio, and S-Video is an older analog format. HDMI bundles both audio and video digitally, which is why it became the go-to connector for TVs, monitors, and motherboard rear panels alike.

What maximum theoretical data transfer speed does USB 3.2 Gen 2×2 support?

Impressive! USB 3.2 Gen 2×2 achieves 20 Gbps by using two 10 Gbps lanes simultaneously — that’s what the ‘2×2’ means. It requires a USB Type-C connector and is most commonly found on high-end motherboards, making it ideal for fast external SSDs.

The correct answer is 20 Gbps. The ‘2×2’ in the name is the key clue — it bonds two 10 Gbps channels together. USB naming got notoriously confusing around this era, with the same physical port potentially supporting very different speeds depending on the generation label printed in the spec sheet.

What is the role of the M.2 slot found on most modern motherboards?

Well done! M.2 is a compact form-factor slot that most commonly hosts NVMe SSDs, which connect via PCIe lanes for blazing-fast storage speeds. Some M.2 slots also support SATA-based SSDs and Wi-Fi/Bluetooth combo cards, making the slot surprisingly versatile.

The correct answer is housing compact storage drives or wireless cards. M.2 replaced the older mSATA standard and supports both PCIe NVMe drives and SATA drives depending on the slot’s keying. NVMe M.2 drives can achieve sequential read speeds many times faster than traditional SATA SSDs.

Which audio connector color on a standard PC rear I/O panel is designated for the main stereo line output to speakers or headphones?

That’s right! The green 3.5mm jack is the standard line-out port used for speakers and headphones in the PC audio color-coding scheme. Blue is line-in for recording, and pink is the microphone input — a color system that’s been consistent across PC motherboards for decades.

The correct answer is green. PC audio jacks follow a long-standing color convention: green for headphones and speakers, blue for line-in (recording from external sources), and pink for the microphone. It’s one of those legacy standards that has quietly persisted even as USB and digital audio have become more common.

Challenge Complete

Your Score

/ 8

Thanks for playing!

USB-C (almost) solved the problem

So close, but not quite there yet

Released to the public in the mid ’90s, USB came to the rescue. The “U” is for “Universal” and for the most part USB has lived up to that promise. Now there was one port that handled data and power. More importantly, USB is fully backwards compatible. So if you plug a USB 1.1 device into a modern USB port, it should work. Whether you can get software drivers for it is another story, but it will talk to the host device.

USB-C has proven to be less universal than I’d like, and the situation is still far better than it used to be. A single USB-C port on one of my laptops can act as a video output for just about anything, even an old VGA monitor.

A Macbook, CRT monitor, and iPad connected together. Credit: Sydney Louw Butler/How-To Geek

My smaller laptops don’t need special chargers anymore, and the latest laptops can pull 240W over USB-C, which is enough for all but the beefiest desktop replacement machines. There is no type of peripheral I can think of that doesn’t give you the option to use it over USB.

But the complaints aren’t so much that we only get USB these days, it’s more that we get so little of it.

Minimal I/O enables better hardware design

Harder, better, faster, stronger

When you only put a handful of USB-C ports on a mobile computer, you reap numerous benefits. The low profile of USB-C means the laptop can be thinner, and the frame can be a stronger and more rigid unibody design. Internally, you have room for more battery, larger performance components, or better cooling.

A green Apple MacBook Neo on display on a wooden table with a product sign behind it. Credit: Patrick Campanale / How-To Geek

It also means the internals can be simpler, and cheaper to design and fabricate, though whether those savings are passed on to customers is another story altogether.

Wireless and cloud-first workflows reduce physical dependency

I guess they are “air” ports

Perhaps the first sign of major change was when smartphones dropped headphone jacks, but the fact is that wireless technologies are now good enough for most peripheral and data connections. So, there’s no need to connect them directly to a port on a computer. Which, in turn, means that there’s no reason to have as many ports on the computer in the first place.

I can’t remember the last time I used a wired mouse or keyboard, and I only use Ethernet for devices that need extremely high speeds, low latency, or improved reliability. For normal day-to-day use, modern Wi-Fi is just fine. So while your laptop might not have as many wired ports on the outside, those wireless chips on the inside still give it numerous connectivity options for audio, input, and data transfer.

You could even make the same argument about storage to some extent, with many thin and light systems leaning on cloud storage to make up for a lack of ports to connect external storage.

MacBook Neo colors on a white background.

Operating System

macOS

CPU

A18 Pro

The MacBook Neo with the A18 Pro chip is Apple’s most affordable laptop yet, with all-day battery life and buttery-smooth performance in a thin and light profile.



The dongle backlash misses the bigger picture

The last bit of the port protest centers around dongles, but I never understood the complaints. Having one port that can be broken out into whatever ports you need using a little box is amazing. It makes ports optional and gives you the choice. If you never plug your laptop into anything, why deal with all the ports you’ll never use?

Likewise, if you only ever use ports with your laptop when you dock it at a desk, then you can just leave your dongle ready to go on your desk, but throwing a small dongle in your laptop sleeve or bag in case you might need it is a small price to pay for all the benefits of minimal IO.



Source link