With Siri set to see some significant improvements once iOS 13 ships, Apple is appearing at a key voice AI tradeshow and has published a study explaining some of the details of a first of its kind machine learning tech it calls “Overton”.
Defining a machine learning window
This week, Apple is sponsoring the world’s largest spoken language processing conference, Interspeech 2019.
As part of its work at this event it has submitted multiple research papers and members of its growing machine learning teams will meet attendees there.
[Also read: iPhone 11: What is Deep Fusion and how does it work?]
Among other topics (see them all here), Apple will present papers on detecting expression/intent through voice, improving voice recognition, more accurate tools to understand speech nuances, experiments in use of mirroring to build relationships between human users and speech assistants and technological solutions to optimize speech enhancement.
We we may learn a little more about what the company is up to in ML at the all-new Interspeech Youtube portal, though we don’t know if any Apple video will appear there.
It’s not such a shock Apple’s scientists are engaging with the wider scientific community.
The company has published sporadic machine learning papers and announcements on its own Machine Learning portal since 2017.
Apple claims to have a first of its kind solution with Overton – it aims to enable much of the personalization of ML models to be administered by the machine, not the human.
Voice interaction is only the front-end of what happens when you ask Siri a question.
Machine learning models must then try to understand the question, contextualize it and must also work to figure out the most accurate response. Delivering a high-quality response is actually harder than it seems.
Sure, for some interrogations all you’ll get from Siri will be data it’s found on a Wikipedia page, (though even then it might have checked several such pages to elect the most relevant response), but the eventual aim must be that Siri becomes an effective source for complex answers to complex problems – even to the extent of predicting them.
These next steps are hard to accomplish.
How can scientists become more confident that the response Siri has to make is the most accurate available?
That’s the kind of challenge Apple is addressing with Overton, which “automates the life cycle of model construction, deployment, and monitoring”.
In human terms that means the machine itself fixes and adjusts machine learning models in response to external stimuli, making it more accurate and repairing logical flaws that might lead to an incorrect conclusion.
The idea is that humans can then focus on the high-end supervision of machine learning models.
This (I think) means that rather than needing to get deep inside increasingly complex code to make minor but necessary adjustments, they can request a set of changes Overton then applies.
Quite literally, controlling the Overton window.
How will Apple use this?
I think Apple’s ambitions for Siri extend beyond it being the digital equivalent of the slightly useless friend you sometimes ask questions of knowing you may not get a useful response.
Siri is intended to be a voice-led helper capable of bringing high-level information, contextualized analysis and augmentation of the tasks you already do. Siri Suggestions shows that direction, though the implementations remain limited.
Apple tells us: “A major direction of on-going work are the systems that build on Overton to aid in managing data augmentation, programmatic supervision, and collaboration.”
Think about it like this:
Apple’s scientists build models they believe to be highly accurate. These models run on the iOS device. Overton provides those models with a degree of independence, ML systems adjust models for accuracy and relevance, all without giving researchers granular insight into individual actions.
This means data managers (in this case the scientists creating those models in the first place) occupy more generalized strategic roles in which information concerning individual users is not made available to them.
Apple creates ML machines to handle certain defined tasks, while also equipping the machines themselves to personalize the models they use.
This seems to be what Overton is about – and was certainly part of what drove it to purchase Silk Labs.
Apple saysOverton is the first machine learning management system to be equipped to improve and monitor application quality.
Tomorrow’s world is a work in progress.
Copyright © 2019 IDG Communications, Inc.