apple’s-siri-will-finally-work-without-an-internet-connection-with-on-device-speech-recognition

Apple’s Siri will finally work without an internet connection with on-device speech recognition

Apple’s digital assistant Siri will now process audio on-device by default, meaning you can use the feature without an internet connection. Apple says the upgrade will also make Siri more responsive.

Processing audio on-device will also make using Siri more private, says Apple. This follows the company’s well-established preference for implementing machine learning features on-device, rather than sending data away to the cloud.

“This addresses the biggest privacy concern we hear from voice assistants, which is unwanted audio recording,” said an Apple presenter during WWDC.

Developing… we’re adding more to this post, but you can follow along with our WWDC 2021 live blog to get the news even faster.

apple-is-making-airpods-easier-to-hear-with-and-find

Apple is making AirPods easier to hear with and find

Apple has announced that AirPods will be getting some quality-of-life improvements with iOS 15, including the ability to boost the sound of people talking to you, better Find My support, and the ability to announce a wider range of notifications.

Apple says the “Conversation Boost” feature will help people who have difficulties hearing other people’s voices when they’re talking. It will try to isolate the voice of the person in front of you, with sliders that let the user control how much ambient noise is let in.

AirPods can already announce messages and texts, but now they’re getting the ability to read out other important notifications, like when a food delivery is made.

The easy-to-lose headphones are also getting more Find My abilities, including an AirTag-like proximity view that tells you how far away your buds are. Using the same tech, your phone will also be able to alert you if you’re about to leave your AirPods behind.

AirPods will, of course, support the spatial audio in FaceTime feature announced earlier in the show, as well as spatial audio on Macs and Apple TVs.

Developing… we’re adding more to this post, but you can follow along with our WWDC 2021 live blog to get the news even faster.

you’ll-soon-be-able-to-use-your-iphone-as-id-at-the-airport

You’ll soon be able to use your iPhone as ID at the airport

Apple has announced a forthcoming update to its Wallet app that will allow you to use your iPhone as digital identification in US airports. The company showed how you’ll be able to scan your driver’s license or state ID in participating US states, which will then be encrypted and stored in the iPhone’s secure enclave. The company says it’s working with the TSA to enable the iPhone to be used as identification at airport security checkpoints.

As well as secure ID, Apple says it’s working to allow hotels to distribute room card keys via Apple Wallet, allowing you to collect a room key before you arrive at a hotel. Home keys and work keys were also announced as coming to the Wallet app.

ID cards can be brought into Apple Wallet by scanning them.
Image: Apple

Apple Wallet launched with support for card purchases before expanding to cover other use cases like transit passes. Apple reiterated that it’s also adding features for unlocking cars using recent iPhones’ ultra-wideband support with BMW and other car manufacturers.

Developing… we’re adding more to this post, but you can follow along with our WWDC 2021 live blog to get the news even faster.

apple-announces-ipados-15-with-homescreen-and-multitasking-improvements

Apple announces iPadOS 15 with homescreen and multitasking improvements

Weeks after introducing its most powerful iPad Pro devices ever, Apple is today announcing the latest version of iPadOS — and there’s a clear focus on making Apple’s tablets more capable productivity machines. At least if you find yourself using split-screen mode a lot, that is. Otherwise, there aren’t any radical changes for the platform.

As rumored, iPadOS 15 will make the homescreen more customizable and allow for more flexible placement of widgets. You can now stick them anywhere you’d like, a capability that came to iOS 14 last year. But iPadOS 14 didn’t offer the same functionality, and widgets could only be placed in the Today View sidebar despite the tablet’s vast screen real estate.

Apple is also bringing the App Library to iPadOS. Much like on the iPhone, it will let you maintain a less-cluttered homescreen by filing away the apps you rarely use to an automatically organized section of folders. On iPads, the App Library is located in the dock.

Multitasking is also getting some much-needed refinement. New icons will make it simpler to go into split-view mode, and Apple also mentioned a “shelf” feature that makes it easier to jumble different tasks. It’s a significant change to how multitasking currently works on iPadOS, and it seems like a major improvement.

Multitasking is getting more intuitive in iPadOS 15.
Image: Apple

QuickNote is a new convenience that will let you attach notes to webpages and other areas of iPadOS, making them easier to get back to.

Finally, the standalone Translate app is also now coming to iPadOS.

New tricks shared with iOS 15 on the iPhone

iPadOS 15 will also share many of the new features and experiences that are coming to iOS 15. FaceTime calls will now support spatial audio for more lifelike, natural sound. A voice isolation feature will let your voice cut through background noise, and a “wide spectrum” option will pick up more sound than before. Portrait mode is also coming to FaceTime, resulting in a blurred background that keeps the focus on your face.

Apple is introducing a new SharePlay feature for FaceTime that allows people to share media — music, movies, etc. — together on a group call. SharePlay will leverage iOS features like picture-in-picture, iMessage, and more for a seamless experience across multiple devices at the same time.

The new iPad software update includes new tools meant to help you focus, like revamped notifications that are easier to identify and a “notification summary” section that recaps your less-than-essential notifications. You can also customize which notifications you’ll see at different points of the day, allowing you to separate work and personal alerts. Focus preferences are synced across Apple devices.

Memories in the Photos app can now synced up with music tracks with automatic filters and effects applied based on the vibe of the song, and Spotlight search is also getting some deeper search capabilities. Live Text is a feature that uses on-device intelligence to let you select text from photos you’ve taken and those in your camera roll. It supports seven languages.

Apple punts for another year on “pro” requests

The M1-powered iPad Pros are on equal footing with Apple’s latest iMac, MacBook Air, 13-inch MacBook Pro, and Mac Mini in terms of sheer performance. Their release has only fueled calls for Apple to evolve iPadOS into a platform that can properly take advantage of all that power for those trying to use the devices as laptop replacements. Using an iPad is a fantastic experience that can regularly turn frustrating when you run into its software limitations.

On the pre-WWDC wishlist of some users were things like multi-user support, a more advanced Files app, better support for external displays, and pro-caliber apps like Final Cut and Logic making their way to the iPad. Apple didn’t address many of those wants in today’s keynote. The most “pro” capability announced was the ability to create and ship apps using Swift Playgrounds. So we’ll have to see what other improvements and surprises iPadOS 15 may hold as it enters beta in the coming weeks.

Developing… we’re adding more to this post, but you can follow along with our WWDC 2021 live blog to get the news even faster.

apple’s-live-text-is-going-to-read-all-the-text-in-all-your-photos-with-ai

Apple’s Live Text is going to read all the text in all your photos with AI

Apple has announced a new feature called Live Text, which will digitize the text in all your photos. This unlocks a slew of handy functions, from turning handwritten notes into emails and messages to searching your camera roll for receipts or recipes you’ve photographed.

This is certainly not a new feature for smartphones, and we’ve seen companies like Samsung and Google offer similar tools in the past. But Apple’s implementation does look typically smooth. With Live Text, for example, you can tap on the text in any photo in your camera roll or viewfinder and immediately take action from it. You can copy and paste that text, search for it on the web, or — if it’s a phone number — call that number.

Apple says the feature is enabled using “deep neural networks” and “on-device intelligence,” with the latter being the company’s preferred phrasing for machine learning. (It stresses Apple’s privacy-heavy approach to AI, which focuses on processing data on-device rather than sending it to the cloud.)

Live Text works across iPhones, iPads, and Mac computers and supports seven languages.

In addition to extracting text from photos, iOS 15 will also allow users to search visually — a feature that sounds exactly the same as Google Lens.

Apple didn’t go into much detail about this feature during its presentation at WWDC, but said the new tool would recognize “art, books, nature, pets, and landmarks” in photos. We’ll have to test it out in person to see exactly how well it performs, but it sounds like Apple is doing much more to apply AI to users’ photos and make that information useful.

Developing… we’re adding more to this post, but you can follow along with our WWDC 2021 live blog to get the news even faster.

apple-is-building-video-and-music-sharing-into-facetime

Apple is building video and music sharing into FaceTime

Apple is bringing video and music sharing to FaceTime through a feature it’s calling SharePlay. Using SharePlay, people will be able to watch or listen to content in sync with everyone else on the call, either by casting the content to an Apple TV device while staying on the call or by watching both on the same screen using Picture in Picture.

SharePlay won’t be limited to just Apple TV Plus and Music, though — it’s an API that other developers can integrate their services into, and Disney Plus, Hulu, TikTok, and more are already on board (though Netflix is notably absent).

These services will support SharePlay.

The feature will even be supported for users who are joining the call using the newly announced FaceTime for the web.

Developing… we’re adding more to this post, but you can follow along with our WWDC 2021 live blog to get the news even faster.

watch-apple’s-wwdc-event-here-at-10am-pt

Watch Apple’s WWDC Event Here at 10am PT

(Image credit: Shutterstock)

Apple’s WWDC (short for worldwide developers conference, an interesting name for a string of commercials) event is back for its second virtual showing, and its keynote starts today at 10am PT/1pm ET. The event will continue through the week with workshop videos, lab appointments, challenges, etc.  We’ve got the lowdown on everything you need to know about the event, including when it starts, where to watch it and what to expect.

When does WWDC start?
 

WWDC’s keynote starts at 10am PT/12pm CT/1pm ET. Apple’s State of the Union address will follow at 2pm PT/4pm CT/5pm ET. After that, developer sessions will be available free through both the Apple Developer website and the Apple Developer app.

Where to watch WWDC? 

We’ve embedded the keynote livestream up top, so you can watch along right from this page. You can also click through to Apple’s YouTube channel to watch the keynote in a separate tab.

 What to expect? 

A report from Bloomberg has us expecting new redesigns for both the MacBook Pro and the MacBook Air, as well as a potential M2 chip reveal. The report says that Apple currently plans to offer two different chips, codenamed Jade C-Chop and Jade C-Die, that would each have 8 high-performance cores and 2 energy-efficient cores. The M1 already boasts impressive power and battery life, so we’re curious to see how Apple’s gamble on in-house chips might continue to pay off.