WWDC 2021 Keynote - Summary

-

 WWDC 2021 Keynote - Summary


  • Starts with developers around the world giving out crazy ideas to start the event with a short film for it


  • Tim Cook enters into an auditorium with a huge audience with Memoji faces


  • iOS: (Enter Craig, the hero)

    • Introduces iOS15
    • FaceTime
      • Audio:
        • Spatial audio in FaceTime (Sound that comes in the position of the person in the video)
        • Microphone - Voice Isolation prioritizes the audio of the person in the video talking
      • Video
        • Highlights the person talking
        • Portrait mode (blurs the background)
        • Facetime Link to invite for calls (anybody from the web could join the call)
      • SharePlay - Listen to music, watch movies, share screens, 
      • Share playback controls [Very much required in the post-covid world] (API’s open for 3rd part developers)
    • Messages:
      • Images collage/stack view in Messages app [News App will have a separate section that lists all the links shared by others]
      • Music, Photos & other apple apps content gets linked
    • Focus:
      • Notifications Summary - A new grouping of social(depending on your usage) notifications 
      • Group apps into your own categories and a time slot for them
    • Live Text - Copy/paste text by taking a pic from the camera instantaneously - 
      • A nice feature that demonstrates Deep neural network implementation [Works with many languages]. 
      • You can search for objects, landmarks. 
      • You can search(spotlight) for the photos with location, people, text, numbers, landmarks, etc
    • Photos:
      • Apple Music applies to the memories with videos built on the fly with the help of ML algos
    • Wallet:
      • Remove your keys: Unlock the car, home (with partners systems)
      • Driving License linked to Wallet makes to prove your identity
    • Weather:
      • New design, animations & layout representing the real weather
      • Full-screen weather/heat maps
    • Maps:
      • 3d layouts, new colors, night mode & layout for landmarks, roads, etc
      • Rich annotations & roadmap for drivers
      • Augmented reality-based direction for top cities to start with
    • + much more (not explained)

  • EarPods/ AirPods:

    • Helps Focus on the person talking in the front
    • Announce Notifications w/o looking at the iPhone
    • Find EarPods with maps’ proximity sensors
    • Notifications alert when you leave your EarPods behind
    • Spatial Audio with dynamic head tracking
    • Dolby Almost on Apple Music for most music

  • iPadOS:

    • Introduces iPadOS 15
      • Widgets:
        • Widgets customization on many levels
        • App Library for better categorization/organization
        • Option to Hide pages
        • Option to Reorder pages
      • Multitasking:
        • Buttons to divide the screen
        • Overlapping of multiple windows in the app
        • Introduces Shell (= dock in Mac)
      • Notes:
        • Mention people 
        • Activity view
        • Add tags (Fab!, I love it)
        • QuickNote 
          • Appears when dragged from the right bottom
          • I can draw or write/scribble anything
          • Can copy/paste link by placing it on top of the browser
          • Tapping on the Highlighted text in any given app takes me to that page
      • Translate:
        • Auto translates the audio and converts it to text
        • Translate text in the image
        • Everything is done on-device
      • Swift Playgrounds:
        • Build apps on iPad
        • Code completion
        • Library of components, documentation
        • Run it full screen to try/test it out
        • Submit apps from the iPad itself (No need for mac to develop apps for iOS/iPadOS)

  • Privacy:

    • ATT (already into iOS 14.5)
    • Mail: 
      • Mail Privacy Protection:
        • Hides your IP address
        • Hides your location
        • Hides if your emails are open
    • Safari:
      • Hides IP address
    • App Privacy Report: 
      • Reports what capabilities are used by apps and data sent to the domains by the apps
    • Siri:
      • Process all data on-device
      • On-device audio recognition (Audio never leaves device) [No internet connection is required for on-device operations]

  • iCloud:

    • Account Recovery:
      • Calls the contacts added
    • Digital Legacy:
      • Data sent to Legacy contacts
    • iCloud+:
      • Private Relay:
        • Browse with safari privately - No data is tracked by domain or anybody, not even apple
      • Hide My Email: Create anonymous emails
      • HomeKit secure video

  • Health:

    • Mobility:
      • Walking steadiness / Fall Risk
        • Measure how fast/slow you walk
        • Balance/stability / double support
    • Labs:
      • Lab results described
    • Trends:
      • Change in Steps, blood glucose, sleep
    • Share Health data with the doctors (Only supported partners)
    • Family: Sharing Health data with the family members

  • watchOS:

    • Introduces watchOS8
      • Breath App:
        • New animation for meditation
        • Reflex: with a message
      • Sleep App:
        • Sleep time
        • Respiratory Rate
      • Finess+
        • New workout types
        • Related music playlists
      • Photos:
        • Portrait photos as watch face
        • Memories, featured photos, etc
        • Share right from the watch with a message including dictate, scribble, emojis

  • Home:

    • HomeKit: AppleWatch or iPhone to unlock the door
    • Ask Siri to watch something on Apple TV completely hands-free
    • Watch TV with friends together (FaceTime features)
    • Shared with you section
    • HomePod Mini for speakers (meh)
    • Matter (?? Not sure)
    • Home App on Apple Watch
    • Cameras on Apple Watch
    • Turn on the outdoor lights

  • macOS:

    • Introduces macOS Monterey
    • Supports all the collaborative features introduced on iOS & iPadOS
    • Universal Control: To move the control between Mac & iPad or/And iMac (Like multi-screen support) [this is really a WOW feature]
    • AirPlay to Mac (Airplay from other devices, play music, share content)
    • Shortcuts: Automate everyday task like on iPhone [define workflow]
    • Safari: 
      • Redesigned layout - Tags & search bar is mixed up
      • Tab groups on side panel/menu - synced across Apple devices 
      • On iPhone, the app is totally redesigned
      • Safari Extensions on iPhone

  • Developer Technologies:

    • API:
      • Shared playback controls
      • Focus Notifications
      • Advanced rendering
      • Object Capture (macOS) - 
        • Creates 3D image by combining a series of 2D images - useful to showcase objects in AR (This is a WOW feature)
        • Made with Swift
      • + much much more
    • Swift: 
      • Concurrency - async/await/actor
    • App Store:
      • Metrics:
        • 600 million apps
        • Paid $230 billion
      • Create customized pages to showcase the app
      • In-App Events - will be surfaced in the App Store product page [Like Live events, upcoming events]
    • Xcode Cloud: [WOW, WOW, WOW !!!]
      • Once changes are committed, it automatically builds the app in the server (Your Mac is free to use it up for other features)
      • Anybody in the team can see the results
      • Test results are displayed in Xcode
      • Source code is built in the temporary built environment
      • TestFlight for Mac:
        • Could be used to test In-App purchases
      • Try free Beta today
      • Will be available next year








Comments

Post a Comment

Popular posts from this blog

Android from iOS Guy's Perspective

-
Image
I got a chance to learn Android Development through this course on Udemy , which is very good for freshers or even noobs like me or the one with literally no experience Programming at all. I have just completed it ( Believe me: I have listened and followed all the videos and have experimented all those fundamental/basic codes ;) ) and wanted to share my experience with this MOOC. I believe that MOOC will vanish the standard academic learning in the coming days. Since, i have been doing only iOS apps for a very long time, being basically an iOS dev, the perspective of this post comes from that point of view. So, here goes my thoughts on the Android Eco system at first: I haven't really been an avid Android user, since i haven't owned a phone yet, but i would have to admit that it really was a wonderful experience throughout the course learning and knowing about the  Eco system itself. Before going into the course, i would like to thank the Udemy team and...
Read more

Free Hand Drawing on Google's Map View

-
Recently, I got a chance to work on a project, where we needed to provide an ability to users of an iOS app to draw on Maps. Basically, we decided to go with Google Maps, because of its overall coverage and its popularity. Hence, we used  Google Maps SDK for iOS  and we wanted to implement "Free Hand Drawing on the Google Maps". To do so, I started searching around the internet for some good resources, but weren't able to find any good one that could just be used like Plug and Play. We had to do a lot of handling on our own and hence decided to write a blog post and a sample project just to make it useful for others, so that others in the same path don't struggle much like me. If you are only planning to draw a Polygon on the Map (As most of them do), then may be you don't have to read the entire post. Instead just follow these steps: (i) Copy & Paste these Folders into your project: "SARMapDrawView", "Categories" & "Models...
Read more

Free Hand Drawing on Apple Maps

-
Image
This is kinda a note based on the learning I've had working with the Free Hand Drawing(FHD in short) on all the major Maps(Google, Mapbox & Apple Maps) on the market. So, If you'd like to have an in-depth technical understanding, please refer this  post which was my first experience with FHD on Google Maps that delves deep into the Google Maps SDK explaining the FHD functionality & its implementation. And to get a context on the Mapbox based FHD solution, please do refer this blog. What I learned with Apple Maps: Apple Maps iOS SDK doesn't differ much from Mapbox iOS SDK, most of the API's has almost the same signatures/pattern, it almost looks like a copy-paste from a developer(API User)'s perspective, Not sure if Apple Copied from Mapbox or vice-versa(I pick this), but the mapping system works totally different internally especially w.r.t the FHD features like polylines, polygons etc. The FHD works smoother on Apple Maps and there are some major di...
Read more