AI Classify
The focus of v4.8.0 development was on finding a way to provide off-device AI image analysis support. This was accomplished via the new AI Classify* Integration, which you can read more about here.
It works like this: you set up an AI image service (this could be self-hosted or even something as simple as Cloudflare Worker AI). You create a new Integration in Streamie that points to this service and you enable this new Integration for one or more of your cameras. When those cameras are streaming decoded video frames will be sent to the external service for analysis. Responses from that service can be rendered and displayed in Streamie (such as boxes that highlight and label objects).
Check out the demo video.
Group Auto Layout
The unexpected and unplanned addition to v4.8.0 is automatic layout, which is not a feature I had previously considered. It was brought up in conversation with a potential customer and turned out to be relatively quick to implement (at least in its current form, which may or may not end up being suitable to that user; to be determined).
The gist is this: by default, Streamie arranges cameras to scroll vertically. Optionally, this can happen horizontally. In this new use case, you just want all of the cameras on the screen with no scrolling involved. Additionally, you want minimal wasted space (the cameras should be as large as possible to maximize use of the available space). When the Streamie screen size is adjusted, the layout of the cameras should be adjusted accordingly. It’s a pretty great feature and one that should have occurred to me earlier.
This demo video below shows Streamie running on a Mac, where the window size can be arbitrarily changed. The primary use case is for multitasking on an iPad, where the Streamie window size can be half-screen, third-screen or in a slide-over position. Check out the demo video.
What’s Next
(1) We are pushing to get camera installers to partner with us. If you’re a camera installer — residential or commercial — looking to differentiate your service, get in touch.
(2) I’m going to see if I can wrangle Streamie and Penguin (the API server) into Swift 6. I have to get it done eventually, so I may as well start now.
(3) We are in talks with a big industrial equipment manufacturer that’s adding cameras to its products and may want some Streamie customization work done. They’ve got our proposal. If they want to move forward, then v4.9.0 plans will definitely change.
Adds
- Adds a new AI Classify Integration that allows you to tie Streamie into an external AI image processor.
- Adds the new "AI Classify" section to each of the camera configuration screens (other than HomeKit).
- Adds Start / Stop Classifying support to the Streamer menu.
- Adds AI Classify support for exporting JPEG, PNG, RAW from a CVImageBuffer without having to deal with UIImage and CGImage.
- Adds a banner image to the top of the All Topics Help web page (help.streamieapp.com).
- Adds Automatic Layout support to Groups.
- Adds a "Reload" button to the Details section of the Rhombus Camera Configure screen.
Updates
- Updates the Help Service so that it can render a direct link to a .shvideo as a webpage with a playable video embedded in it.
- Updates Streamie with the new release notes url for v4.8.0.
- Updates VideoToolboxDecoder to maybe be more resilient when it comes to the vtSession being closed while decoding is occuring.
Improves
- Improves Help Service so that it does a better job of creating the Article link URLs.
- Improves the Group Configure Screen with better explainer text when adjusting the Scale and Layout of the cameras in a group.
Fixes
- Fixes a crash in the Webhooks Screen when tapping on a placeholder cell.
- Fixes (maybe) a crash related to uploading logs. This isn't a GOOD fix; just a possible fix.
- Fixes a crash (maybe) related to remote notification registration.
- Fixes a regression related to Google Nest Dropcam RTSP support. [SP]
- Fixes an analytics service issue where we would pause the service and then never resume it.
Created: 1 month ago
Updated: 2 weeks ago
Author: Curtis Jones
Topics: Release Notes AI
Streamie provides a best-in-class user experience on your iPhone, iPad, Apple TV and Apple Silicon Mac, with an intuitive user interface that makes it simple to discover, stream, record, monitor and share your HomeKit, Google Nest, Ubiquiti UniFi Protect and ONVIF-compatible IP and RTSP cameras. Streamie keeps you informed with motion event notifications and it works with most cameras using its advanced audio and video codec support. You can watch your cameras from anywhere, record 24/7 to your private NAS, remotely manage multiple locations, device permissions and seamlessly synchronize settings across your devices; configure Hubitat smart home automations, live stream to YouTube and rely on the in-app technical support system when you need help -- and you can also reach us by phone. Download Streamie today for all of your CCTV needs.