justin․searls․co

How to make incredible HomeKit backgrounds with ChatGPT

Okay, so there's a great meme going around the /r/HomeKit subreddit right now, where folks are using ChatGPT to generate illustrations for each of their rooms in the Home app. Finally got around to joining in the fun.

Here's how I did it:

  1. Take a vertical photo of each of the rooms in your home that you've configured in HomeKit
  2. Start a conversation with GPT-4o and describe that you want vertical (9:16) illustrations for the Home app based on your photos, and any style preferences (I'll share my prompt below)
  3. One at a time, feed it your photos, and offer feedback until it gets it right
  4. Save each photo to a new album in Photos so you can reference it from the Home app
  5. Over in the Home app, for each room:
    1. Select the room (on iPhone, tap the ellipsis in the corner; on iPad or Mac, select it in the side bar)
    2. Tap the ellipsis in the top right and choose "Room settings"
    3. Choose an image for the room background
    4. Select the image from your Photos library
  6. Do this on every device, because (of course) the Home app still doesn't sync background images

I had a blast setting these up and didn't hesitate to repeat it for all my devices. The bland, samey look of the default HomeKit room design makes it easy to confuse where you are in the app, and these illustrations are nothing short of delightful. Apart from the tremendous image generation capabilities of ChatGPT 4o, photographing rooms without resorting to a comically wide angle fisheye lens is very difficult, and an artistic touch can emphasize the "feel" of a room better than a photo can.

Here's the full set of my rooms:

Oh, and here's the prompt I used:

I have a fun project for you! Please make stylized background images based on the photos of each room in my home that I send you. I'm going to use these as background images for each of my rooms in HomeKit. Important to note, these images must be vertical. 9:16!

Very excited about this. Would love for you to take each image and then remove any clutter (idealize it a bit), use your imagination to come up with an appealing sight line and focal length a bit, and then draw each image in a consistent color palette, namely with a hyperrealistic Japanese animation style that could only be accomplished by pixel-peeping with Adobe Photoshop, Illustrator, and After Effects.

(Humorously, if I let ChatGPT reply to this with text, it would say a variation of, "okay, I'll make some Makoto Shinkai-esque illustrations!" and then, because a particular artist was named, all subsequent images generated in the chat would be found in violation of Open AI's content policy. Amazing.)

Do you HomeKit? Go give this a try and melt some of Sam's GPUs for me. Send me your best rooms. 🏡

Why I love infrared saunas: weighing myself before and after a 60 minute session, I sweat so much that I dropped 1.3 pounds DESPITE drinking 1.68 liters (3.7 lb) of water.

That means in just one hour a 65°C sauna caused me to perspire 2.27 L (5 lb). Holy shit.

My productivity skyrocketed this week. Sleeping better? New AI tool? Nope!

I signed out of iMessage on my Mac. Night and day difference. My computer is for computing again. HUGE difference.

The reason AI startups like Windsurf, Cursor, et. al, are all fucked is that "you’re a product, not a platform" is the new "you’re a feature, not a product."

If you fail to secure a massive acquisition, you're gonna get steamrolled by the big tech companies as soon as they catch up.

First impressions of GitHub Copilot's Agent mode

tl;dr it works. You should try it.

I finally got around to trying the new Agent functionality in GitHub Copilot.

You gotta really know when to ask an LLM for help, though. (I wrote last year how I decide whether to reach for an AI assistant, if you're interested.)

My experience and recent research both indicate that AI works best for creating new stuff from scratch, especially when that code is perfunctory and typical and conventional. That's the reason there's such a divide between people who've had terrific experiences with "vibe coding" and others—like me—for whom all the hours fucking with AI to make it do my job for me have mostly been a waste of my time. Every other time I've tried to use an agent mode in Cursor or Claude Code, I've asked it how to do things that most "staff" or "principal" or "distinguished" engineer have never tried and would have no idea how to do, so naturally they never went well.

But today I'm finally starting work on a new gem, and I had an annoying task that wasn't a legacy rescue, or exploiting a brand new language feature, or doing something totally unlike anything anyone has ever done before. So I fired up the agent mode using Anthropic's 3.7-sonnet model and let it go to work.

Specifically, I asked it to stub out a Rails engine to use as a starting point for moving over existing login functionality into a gem. It did basically everything in the same order and way that I would. It commented out additional hooks I'll probably need, which is nice.

It also gave me instructions for wiring up the new engine from the project I'm extracting the behavior from, which is a nice bonus.

Did it work? Yup:

Cool.

Breaking Change artwork

v34 - Bait and Switch 2

Breaking Change

Nothing like a peaceful Sunday morning at the end of an exhausting, historically-volatile week to pour a hot cup of coffee and spew absolutely scalding takes in all directions. If you get burned, don't say I didn't warn you. Read the message on the lid.

We've done 34 of these now and my mailbag is getting full of old e-mails that don't make sense anymore. Please email new stuff to me at podcast@searls.co and we, like civilization, will start fresh next time!

Video of this edition of the show is up on YouTube.

You can read more about things on other websites below:

Show those show notes…

Microsoft CTO Kevin Scott apparently just said:

"95% of code is going to be AI-generated (in the next five years)," Scott said. But before developers start panicking, he reassured that “it doesn’t mean that the AI is doing the software engineering job…. authorship is still going to be human.”

Panic? Never been a better time to start a company focused on cleaning up bad code and aiding broken organizations and then billing by the hour.

Anyone who still believes the quantity of code one owns is an asset and not a liability is a fool.

In general, I love how Japanese society prioritizes cleanliness, but one thing that's never made sense to me is how the rice sold at supermarkets is absolutely FULL of germs.