As early as 2019, AR and its cloud service and capability integration architecture entered a stage of rapid development in which hundreds of birds competed. Leading companies in ICT, artificial intelligence and the Internet have released dazzling new technologies and expanded their cloud-based service models, such as 3D high-precision map services combined with AR technology-Cybervers and MapsAR navigation based on the visual positioning system LiveView Function.
The integration and mutual incentives between the offline physical world and the online digital world have gradually emerged. At the same time, the advent of the 5G era and the acceleration of commercial deployment have accelerated the flow of digital information and the development of the Internet of Things, and protected digital assets and private information in a safer and more flexible way, making it easier for the integration and activation of the physical and digital worlds. The character interaction mechanism (HTI: HumanThingsInteracTIon) based on visual natural interaction opens up the highway.
Opportunities and challenges coexist. How to actively and rationally view the current development dividends and opportunities of related technologies, and at the same time clarify the core technical issues that need to be resolved quickly, is the important task that the era has given to experts and practitioners in the digital video and machine vision related fields, and it is also a real start. A prelude to the fusion of the physical and digital worlds.
This article is the first in the series of "AR Edge Cloud Technology", and a series of articles on "AR Edge Cloud Technology" will be launched next. Share relevant information with you, so stay tuned!
Definition and important role of AR cloud
Augmented reality (AR) technology combines spatial semantic perception based on visual perception and visual content generation technology based on mixed content rendering, and promotes the naturalness of human and physical world through wearable device system engineering with emerging near-eye display as the core Interaction realizes the information transmission highway of "what you see is what you know" and abandon the keyboard, mouse and monitor.
As the pivot point of a revolutionary human-computer interaction (HTI), AR has assembled a large number of modern technological advances and achievements, including artificial intelligence technology with machine vision and SLAM as the core, as well as cloud deployment and big data integration as the foundation Information background technology, and near-eye display technology with optical waveguide as the current main application mode.
At the same time, a large number of commercial deployment of 5G technology has also become the main pillar of its connection technology. Combining the system technology collection of AR, the integration of the industry's digital knowledge assets and high-speed information interaction based on visual triggers, provide a broader imagination space for intelligent manufacturing, digital twins, and emerging smart city services.
AR Cloud Practice in Intelligent Manufacturing
At this stage, under the trend of intelligent manufacturing, industrial enterprises have begun to explore new ways of informatization to achieve the purpose of increasing efficiency and reducing costs and enhancing corporate competitiveness. Among them, the industrial manufacturing process is also an implementation scenario with complex application scenarios and significant vertical field characteristics.
First: the manufacturing scene exists
The production environment is complex, such as a large number of moving equipment, personnel and vehicles;
The equipment is diverse, whether it is the shape, the internal professional structure, or the electrical and circuit connection topology;
The operating environment of the equipment varies greatly, and there may be operating conditions of high temperature, high risk, and high electromagnetic;
There are many collaborative work sections and processes involved, and high requirements for refined and flexible management.
Second: as the most important factor in the manufacturing process-people
Both the professional skills that need to be mastered and the comprehensive field information that needs to be paid attention to are showing an increasingly rapid development trend. At the same time, the high-speed manufacturing process also requires production personnel to pay more attention to the rapid change production and implementation process.
Following the evolution of the digital information manufacturing process empowered by Internet technology, the interaction (revolutionary human-computer interaction (HTI)) and the acceleration of information flow between the core elements of humans and facilities and equipment has become an important contribution to intelligent manufacturing. An important way to evolve to the next step of productivity improvement.
The current use of AR technology and all-in-one equipment, which can be remote, real-time, active, multi-view integration, multi-scene interaction, and hands-free information presentation forms, assist industrial workers in production and training, and extend the Internet and information technology to The work of front-line employees has been actively practiced by many industrial giants, such as General Motors and GE, and has achieved positive results of greatly increasing the information acquisition and conversion rate of staff, thereby improving labor efficiency. Enterprise Competitiveness".
At present, a relatively complete AR cloud-assisted intelligent manufacturing system includes the use of AR augmented reality technology, AI artificial intelligence technology, IoT, cloud computing, 5G communication technology, and the integration of 5G+MEC edge cloud technology to cloud AR smart terminals The system serves as an intelligent tool connecting on-site operators, equipment, operation and maintenance centers, and off-site personnel, realizing cross-regional data resource sharing, production process supervision and control, and remote guidance by off-site experts.
In the above scenarios, auxiliary AR facilities need to be flexible and portable to the greatest extent so that the work on the production site can be carried out efficiently. The cloud AR intelligent operation and maintenance center is deployed in the cloud to provide AR application services and interactions, as well as data knowledge base precipitation and intelligent analysis services. By executing the AI/AR algorithm engine in the edge cloud computing center, it provides microservice management and online deployment of algorithm models. Service, model operation monitoring and resource scheduling management to improve production efficiency and achieve business closed loop.
The core functional framework of AR Cloud
Cloud AR intelligent terminal system, as an intelligent tool connecting field operators and equipment, operation and maintenance center and off-site personnel, is the core path of human interaction (HTI) and information flow acceleration. At the same time, it requires maximum flexibility and portability, and sufficient battery life. This puts forward a core evolution direction for the entire AR cloud architecture.
Among them, supported by the development of core technologies such as 5G communications, AR smart terminals are deployed locally by application content storage, perception, digital content rendering, user interaction and display comprehensive capabilities, and gradually deployed to lightweight capabilities that only include display and user interaction. Transform, strengthen the integration and acceleration of information flow with the cloud service model, and deepen the level of data services, while improving flexibility and portability.
At the same time, in scenes with complex environments and diverse devices, the front-end completes the spatial recognition of the device objects in the video content and the scene recognition to construct the human interaction (HTI) channel, which requires the support of very complex machine vision algorithms, and effectively utilizes cloud computing. Power also facilitates the extensive use of character interaction and the diversity of application scenarios.
The development trend of AR cloud-AR edge cloud
AR and its cloud services have a broad application field. In the process of its promotion and popularization, the focus of user experience has become the core driving force and indicator for promoting industrial progress and technological change.
Refer to the research report "StateofIndustrialInnovation" (Industrial Innovation Development) series of reports 68% of industrial enterprises are accelerating the adoption of augmented reality, and combined with GSMA-related industrial scenarios research reports, the core issues affecting customer project deployment and scale promotion are mainly derived from Three areas:
※Identify and track positioning (three-dimensional registration), the core link and the overall experience of the technical foundation;
※The component composition and the whole of human-computer interaction, such as the experience of the interactive device AR display terminal and the experience of the overall interactive solution;
※Main issues related to usage and investment costs, such as terminal costs.
The marginal deployment of cloud analysis functions and digital information fusion functions has become an important means to improve areas 1) and 3). At the same time, video content focuses on the spatial recognition of device objects and the expansion of the scope of application of scene recognition (that is, the improvement of AR technology itself). ) It is extremely important to share the cost of equipment use and increase revenue, as well as to improve the experience of identifying and tracking and positioning. The introduction of the brain-computer interface provides an imagination space for accelerating the flow of semantic information and more natural human-computer interaction.