Jump to content
C4 Forums | Control4

AI interpretation of camera feed


wnpublic

Recommended Posts

Sort of a fun thing I'm doing with Home Assistant, but I'd think it should be doable with C4 if someone writes an integration.  When Unifi detects an object (vehicle, person, animal), HA sends a camera snapshot to Google Generative AI with a prompt to interpret what's occurring in the photo.  A notification is then sent to the phone with the AI text and the snapshot. It can be very accurate if the image quality is good and the prompt is good:

 

IMG_2646.PNG

Link to comment
Share on other sites


17 minutes ago, Dueport said:

Damn that is very cool - bravo!

Thanks.  It's fun, but not terribly practical yet as the tech is still developing.  For instance you can tell it to give you license plate numbers, but it tends to hallucinate and give fake ones, even if you tell it "Provide a license plate number but only if you are SURE."  But you can see where it's going to be very cool (and intrusive). The one practical use i've found is that i've got it watching the backyard of an AirBNB to tell me if it spots two or more dogs (only one is allowed).  It's pretty good at that.

Link to comment
Share on other sites

  • 4 weeks later...

Sounds cool.  Is this all pre-baked in Unifi?  I have a Dream Machine SE, but I don’t use Protect.  Wondering how hard it would be to implement via emailed photos form my (non Unifi) NVR.  Not sure I see a C4 angle, but still cool.  

Link to comment
Share on other sites

  • 2 weeks later...
On 3/20/2024 at 6:17 PM, cnicholson said:

Sounds cool.  Is this all pre-baked in Unifi?  I have a Dream Machine SE, but I don’t use Protect.  Wondering how hard it would be to implement via emailed photos form my (non Unifi) NVR.  Not sure I see a C4 angle, but still cool.  

As the other poster noted, it's Google AI.  Home Assistant sends the notification, but it's agnostic as to tech.  Anything that can feed it a picture and a prompt can use it, and the info is just a JSON response.  Would be straightforward to use it in a C4 app notification.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.