•   
  •   
  •   

Technology Apple's ARKit: Cheat sheet

21:55  07 june  2021
21:55  07 june  2021 Source:   techrepublic.com

Best Apple Watch band in 2021

  Best Apple Watch band in 2021 Let's explore some of the best Apple Watch bands available on the market. Case-Mate: Metal Linked band The subtle stunner © Provided by ZDNet best-apple-watch-band-1.jpg The simple and subtle design of this Apple Watch band makes it a stainless-steel stunner. It sports a two-toned finish, with polished inner links contrasted with black matte outer links. This band works in any environment, business or casual. A butterfly-style clasp completes the sleek and sophisticated look.

ARKit was released with iOS 11 at the Apple's Worldwide Developer Conference in 2017. Augmented reality (AR) is at the forefront of specialized technology being developed by Apple and other high-tech companies, and this new kit helps developers bring AR to iOS devices. The development kit is integrated with the latest hardware to allow for a level of AR integration never seen before on iOS devices.

icon: Image: Apple, Inc. © Provided by TechRepublic Image: Apple, Inc. icon: Apple, Inc. © Apple, Inc. Apple, Inc.

This article is an introduction to ARKit. We'll update this resource periodically when there's new information about the AR development framework. It is also available as a download, Cheat sheet: Apple's ARKit (free PDF).

Flower Power: 25 Pot-repreneurs Who Are Invested in Cannabis and CBD Businesses

  Flower Power: 25 Pot-repreneurs Who Are Invested in Cannabis and CBD Businesses Every week it seems another celebrity announces the launch of a new cannabis brand. What started with Snoop Dogg and Willie Nelson in 2015 has gone mainstream; Magic Johnson and Jane Fonda are CBD brand ambassadors now. With the continuing passage of legalization in states across the nation, more such brands will hit the market.

SEE: Augmented reality: Quick glossary (TechRepublic Premium)

Executive summary

  • What is ARKit? iOS includes a framework in the iOS Software Development Kit (SDK) called ARKit. This framework allows developers to create augmented reality apps and take advantage of the hardware and software capabilities of iOS devices.
  • Why does ARKit matter? Like virtual reality, augmented reality is a hot topic in tech. AR allows app users to place virtual objects in a real world, and then interact with them. AR apps will be especially popular for the gaming, shopping, and industrial sectors.
  • Who does ARKit affect? iOS 11 was the first version of iOS that included ARKit, and it has been included in new iOS versions since, allowing developers to create AR experiences in their apps. This also affects users, because they can download and use ARKit apps on their iOS devices.
  • When is ARKit available? ARKit has been available to developers as part of Xcode 9 since its beta release at WWDC '17 in June 2017. ARKit apps has been available to consumers on the App Store with the release of iOS 11 on September 19, 2017.

SEE: All of TechRepublic's cheat sheets and smart person's guides

Apple's new M1 iPad Pro with 5G: Everything you need to know

  Apple's new M1 iPad Pro with 5G: Everything you need to know The latest iPad Pro brings a number of improvements, biggest among them being the inclusion of the Apple Silicon M1 chipset. Here's what professionals will want to know about the latest iPad model.A number of other improvements were made to the latest generation of iPad Pros that make both the 12.9" and 11" a considerable upgrade despite being mid-generation devices, which usually include only minor upgrades.

What is ARKit?

ARKit is an augmented reality framework included in Xcode that is compatible with iPhones and iPads. ARKit lets developers place digital objects in the real world by blending the camera on the screen with virtual objects, allowing users to interact with these objects in a real space.

It does this by using the camera on iOS devices to create a map of the area, detecting things like tabletops, floors, and the location of the device in the physical space using CoreMotion data. The user doesn't have to do any calibration--that's a breakthrough in this space.

More about Apple

  • Apple's WWDC 2021: How to watch and what to expect
  • macOS Terminal commands every Mac user should know
  • iOS 15: The top 3 features Apple should include
  • 10 macOS tune-up tricks for your Mac (free PDF)

ARKit can run on most modern iOS 11 iPhones and iPads, and can utilize Metal's features like SceneKit integration and integrate with third-party tools such as Unity and Unreal Engine.

Mother of Dragons No More, Emilia Clarke Joins the Cast of Marvel's Secret Invasion

  Mother of Dragons No More, Emilia Clarke Joins the Cast of Marvel's Secret Invasion To say we're excited for Marvel's Secret Invasion is an understatement.

ARKit can run on most modern iPhones and iPads, and can utilize Metal's features like SceneKit integration and integrate with third-party tools such as Unity and Unreal Engine.

Apple iPadOS: A cheat sheet

  Apple iPadOS: A cheat sheet Apple's OS for iPad includes features that make it easier to use the iPad as a laptop replacement. Here's what you need to know about iPadOS.As the iPad lineup has expanded into a wholly separate product category, Apple announced at its 2019 Worldwide Developers Conference (WWDC) that it has rebranded iOS for iPad as iPadOS starting with iOS 13 to highlight and target the features that differentiate the iPad from other devices. This follows Apple's naming trend of watchOS for Apple Watch, and tvOS for Apple TV.

For end users, ARKit will enable a new level of real-world integration never before seen on iOS devices. A new generation of apps will be able to be built that can do things like show furniture inside of your house while shopping in an app; show your dream car parked in your garage to see if it will fit; and many other inventive uses of this technology that developers haven't discovered yet.

Apple created a Swift Playgrounds challenge that uses ARKit. The Swift Playgrounds app can be downloaded for iPad from the App Store. Developers and end users can see how these AR apps are created and used.

Additional resources

  • WWDC 2017: Apple launches augmented reality developer tools with ARKit (ZDNet)
  • The first ARKit apps reveal how Apple's AR works (CNET)
  • Apple says new iPhones are 'custom tuned for AR' (ZDNet)
  • WWDC '17 Video: Introducing ARKit: Augmented Reality for iOS (Apple)
  • Developer Video: Face Tracking with ARKit (Apple)
  • Apple's Swift programming language: The smart person's guide (TechRepublic)

Why does ARKit matter?

AR has been a hotbed technology the past several years, and ARKit affirms this technology is here to stay and will become an ever-growing field for apps in the future. The use of AR in spaces other than gaming will be a game changer.

Apple's Swift programming language: Cheat sheet

  Apple's Swift programming language: Cheat sheet Apple's Swift has far-reaching effects on all platforms, not just iOS, OS X, watchOS and tvOS. Learn why Swift matters, how to use the programming language and how it differs from Objective-C.In 2010, Apple started developing Swift, a new programming language that would rival Objective-C in a few areas--specifically, type safety, security, and better on-hardware performance. Swift is more than 2.6x faster than Objective-C and more than 8.4x faster than Python. Swift 1.0 was released in September 2014.

ARKit apps are currently in their infancy, but there is real potential in the apps that can be created with it. Apple has provided an amazing framework that is leaps and bounds better than what was previously available to create AR apps. Developers no longer have to develop a speciality, but instead can use this framework to create AR features in their apps without any prior experience working with AR.

SEE: Executive's guide to the business value of VR and AR (free ebook) (TechRepublic)

With the iPhone X, Apple has created a true AR device with a better camera that will provide both facial tracking and better positioning and topology detection.

In the future, we could see apps that are used by industrial workers, medical workers, scientists, and other technical professionals to overlay critical information over a real-world scene.

Additional resources

  • Augmented reality gaining more traction than virtual reality in the enterprise (TechRepublic Premium)

  • Next big leap for Apple? - augmented reality (CBS News)
  • Google brings AR development to Android phones (TechRepublic)

Which devices and apps support ARKit?

ARKit-enabled devices are any iPhone or iPad running iOS 11 or later that have the Apple A9, A10, A11, or later processor; these devices are required to run the advanced Metal graphics. At launch, most of the apps that support ARKit are in the games category; as more developers work with AR, we will see an increase in the number of useful apps.

macOS Monterey: A cheat sheet

  macOS Monterey: A cheat sheet Apple's powerful new macOS was announced at WWDC 2021. This guide covers everything you need to know about macOS Monterey, including features, requirements and how to get it.With macOS Monterey, Apple is sticking with the theme of naming its OSs after California locales. This version of macOS offers many new features for users, including Universal Control, Shortcuts and AirPlay for iMac, updated capabilities in FaceTime, a redesign for Safari (including Tab Groups) and more.

Some of the popular apps that are available at launch with ARKit support include RoomScan Pro, Human Anatomy Atlas 2018, and Night Sky 5, as well as the following.

Games

  • Egg, Inc. (Free): A farming game that lets you see your farm laid out on a table or floor.
  • Thomas & Friends Minis (Free): In this game you can lay out a virtual train set on the floor.
  • Splitter Critters ($2.99): In this game you can explore a fully playable version of the game overlaid on the floor.

Tools and other apps

  • Overstock.com (Free): Place life-size 3D furniture models in a room to see how they will look; you can even walk around it to get a sense of scale.
  • Edmunds (Free): Place a life-size 3D model of a car that's in their library in your driveway or garage to see if the car will fit.
  • MeasureKit (Free): This is an AR utility that lets you measure a room or other object in real life using a virtual tape measure.

Additional resources

  • Lowe's taps Apple's ARKit for new home improvement apps (ZDNet)
  • The 23 best ARKit apps you can try right now (CNET)
  • Learn Swift Programming Step by Step (TechRepublic Academy)

  • Master Unity Game Development: Ultimate Beginners Bootcamp (TechRepublic Academy)

ARKit 2 improvements

ARKit 2 brought a new vivid augmented reality experience to apps that allowed them to interact with the real world in new ways. With ARKit 2, multiplayer AR games were possible, as well as tracking 2D images, and detecting known 3D objects like sculptures, toys, and furniture.

SEE: Virtual and augmented reality policy (TechRepublic Premium)

ARKit 3 improvements

ARKit 3 adds features that take augmented reality even further. You can show AR content in front or behind people using People Occlusion, which can track up to three faces. You can also now support collaborative sessions, enabling completely new AR shared gaming experiences.

Apple's new iOS 15 features would be a perfect fit for AR glasses

  Apple's new iOS 15 features would be a perfect fit for AR glasses Apple doesn't have a headset yet, but the latest software for iPhones, iPads and Macs keeps building the groundworkIn fact, look more closely, and there are already a lot of puzzle pieces scattered all over the place. Apple's ARkit and RealityKit developer tools added some deeper features to manage more objects and bigger virtual landscapes overlaid onto the real world. Core apps started to get some AR hooks, too: Apple Maps is adding AR directions, like Google Maps already does. Also, much like Google Lens, Apple is introducing ways to read and search for text in photos, or via the Camera app.

Motion capture can be used to understand body position and movement, tracking joints and bones, allowing for new AR experiences involving people instead of just objects.

Other major improvements:

  • Detection capabilities of up to 100 images at a time
  • Estimation of physical size of an image
  • 3D-object detection is more robust and can better recognize objects in complex environments
  • Machine learning is used to detect planes in the environment faster, leading to faster AR environment setup
  • Simultaneous front and back camera use means that you can interact with AR content in new ways with facial recognition
  • Multiple face tracking on iPhone X, iPhone XS, iPhone XS Max, iPhone XR, and iPad Pro can now track up to three faces at once

ARKit 4 improvements

ARKit 4 was announced at WWDC '20 and released alongside Xcode 12 and macOS 11 and iOS 14 later in 2020. With the introduction of LiDR on iPhones and iPads in 2020, Apple decided to add functionality to take advantage of these sensors into ARKit 4. Depth information from the LiDR sensor was added into this version of ARKit to improve tracking and object detection.

In addition, ARKit 4 also added Location Anchors, which is a new feature that uses Apple Maps data to place augmented reality experiences on specific geographical coordinates.

Reality Composer and RealityKit

These new tools available in ARKit can aid in the creation of AR scenes with little to no traditional AR design experience.

For more information, read about Reality Composer and Reality Kit on the Apple developer website.

Additional resources

  • WWDC 2019: The biggest takeaways for developers (TechRepublic)
  • WWDC 2019: A guide for business pros (TechRepublic Premium)
  • Apple's coolest new AR features only work on iPads and iPhones with the newest processors (CNET)
  • What Apple's new AR bowling game taught us about the future (CNET)
  • Apple CEO Tim Cook touts enterprise augmented reality as Apple, SAP further integrate (ZDNet)

When is ARKit available?

ARKit was available beginning in June 2017 to developers in the iOS 11 beta and the Xcode 9 beta. The final version of 1.0 of ARKit was released alongside iOS 11 in September 2017. Developers began making ARKit apps available on the App Store for iOS beginning September 19, 2017. ARKit is bundled with the latest iOS SDKs inside of the latest versions of Xcode.

Version changes

  • June 2017: Apple released the beta of ARKit alongside Xcode 9 and iOS 11 betas.
  • September 2017: Apple announced iPhone X with TrueDepth camera, which enables ARKit to detect position, topology, and the user's facial expressions.
  • September 2017: Apple released iOS 11 to the public and Xcode 9 to developers with the newly included Face Tracking features in ARKit.
  • November 2017: Apple will release the iPhone X to the public, and developers will be able to take advantage of the facial tracking features in the TrueDepth camera system.
  • June 2018: iOS 12 beta is released to developers at WWDC, bringing a beta version of ARKit 2.
  • September 2018: Apple releases iOS 12 to the public, bringing ARKit 2 to iPhones and iPads, allowing developers to release ARKit 2 apps publicly.
  • June 2019: iOS 13 beta is released to developers at WDWC, bringing a beta version of ARKit 3.
  • September 2019: iOS 13 is released to the public, brining ARKit 3 to the public through new third-party apps and experiences.

  • June 2020: iOS 14 beta is released to developers at WWDC, brining a beta version of ARKit 4, with LiDR improvements for the recently released 2020 iPad Pro with LiDR sensor.

  • September 2020: iOS 14 is released to the public, bringing with it apps able to support ARKit 4 to the App Store.

Additional resources

  • Udacity, Unity launch new $200 developer training course for Apple's ARKit (TechRepublic)
  • Developers: These are the iPhone X, iPhone 8, Apple TV 4K, and Apple Watch Series 3 features you need to know (TechRepublic)
  • With the iPhone X, can Apple become the next AR leader? (TechRepublic)
  • Apple unveils iPhone 8, 8 Plus as 'first smartphone designed for AR' (TechRepublic)

Apple's new iOS 15 features would be a perfect fit for AR glasses .
Apple doesn't have a headset yet, but the latest software for iPhones, iPads and Macs keeps building the groundworkIn fact, look more closely, and there are already a lot of puzzle pieces scattered all over the place. Apple's ARkit and RealityKit developer tools added some deeper features to manage more objects and bigger virtual landscapes overlaid onto the real world. Core apps started to get some AR hooks, too: Apple Maps is adding AR directions, like Google Maps already does. Also, much like Google Lens, Apple is introducing ways to read and search for text in photos, or via the Camera app.

usr: 3
This is interesting!