Brief Top-10 Apps
Augmented Reality Head-up Display Fullface Mask or ARHUDFM
In short, it's an extensible hardware platform and multi-product SaaS (super-app) for tactical tasks across all domains and civilian emergency services. Key features:
- Built-in neural networks and language model
- Multi-cameras system with different sensors and optics. SWIR/LWIR and Full Synthetic Night vision
- Microphone array system with different directional patterns
- Voice, gesture, and joystick control with buttons
- High-performance processors and independent controllers for sensors
- Multiple partitions for security and low user visibility
Today we will show some functionality only in the focus of AI-powered Situational Awareness. The development is based on research, publications, and innovation requests for:
- Marine Corps and Army rifle units for tactical operations, training in real and synthetic environments, and training recruits
- Armored units and throwing artillery
- Engineering units, tactical medicine, and combat logistics
- Flight Deck services and maintenance personnel of Navy ships
- Operators of unmanned aerial vehicles, sea and ground robots
- Snipers and Special Operations Forces
Basic interface principle. Anything that is not needed at the moment should not be displayed. The user chooses the options to fill the view independently. In most cases, synthetic visual images cover no more than 10-35% of the field of view. The user never loses touch with the surrounding reality and always retains peripheral vision. The primary method is native voice control through an AI assistant. Additional methods such as gesture control and one-handed button joystick control are sometimes also useful. The mask is the core of the platform and its brain, which includes additionally integratable external sensors and devices for various functions and tasks. The functionality is capable of meeting the current and future needs of different categories of armed forces, including the "Soldier as Sensor" concept.
The main menu has two levels of items and filter counters that show the total number of notifications for the mission period and those requiring user response. The quick menu shows applications in the background and allows you to quickly open the necessary ones in the window. The status bar is always shown and allows you to manage all important parameters of the device's operation. The widget menu displays key indicators of important attention areas: vital signs, ammo stock, tactical statistics, device status, mission tracking, weather forecast, dangerous environment, and more. A rearview camera provides additional safety and situational awareness at all times. The notification window is very functional despite its small size. The electronic compass and angle gauge window help you navigate with high precision. It's also integrated with the navigation grid and allows you to quickly find the focus on the desired object. On the sides are auxiliary windows for active applications. Up to 10 application windows can be located in the center, left, and right. They can be enlarged vertically, horizontally, 2x, and can be moved sideways.
The Identification Friend-or-Foe module's navigation grid is the most important part of the functionality that allows you to have detailed theater situational awareness. On the left side, objects, routes, and references for objects in the air are displayed, as well as threats to the user from these objects. The right side displays information about objects on the surface of land and water. Allows quick access to detailed information collected by satellites, AWACS, drones, and user sensors. Integrated with other device applications. Includes Friend-or-Foe Identification, which allows you to orient yourself in the environment quickly. Has a separate display of objects by type and easy zoom control. Allows you to use georeferencing. Shows historical data of movement routes and probable direction. Has filters for units and missions. Has an integration with compass, maps, route tracker, messenger, media player, fire assistant, tasks, and other apps. Saved custom views help you quickly switch between them. Has a built-in neural network for data processing. Insignificant data exchange flow.
Omnichannel Messenger allows you to unify all user communications, significantly reduce the duration of communication sessions and the flow of data exchange, and use logging and monitoring capabilities of received messages. All outgoing voice messages are transcribed to text and transmitted in 256-bit encrypted form. All received messages are voiced by the voice assistant and can be read. Message filters allow you to show only important, favorite, unviewed, and all messages. Smart filters for the period, chats, and users, automatic topic creation, and smart search by topic and content. All messages are grouped into reply chains. Importance markings and sending reply requests help in the flow of communications. Intelligent guest chat mode allows you to communicate with other departments and domains efficiently and easily. Unique ability to view the message tree from anywhere to understand who, to whom, what, and what is being replied to. The ability to control who reads a message and when. The ability to write, read, reply, and forward to multiple chat rooms at the same time. Types of quick attachments to each message include exact locations of friendly and enemy forces, images, short videos, streams, application window screenshots, and files. Outgoing messages can have a mandatory reply request. Has a built-in neural network for data processing. Insignificant data exchange traffic with the highest possible communication quality.
The universal RC controller allows you to control up to four different types of drones simultaneously by voice or joystick and buttons with the help of an AI assistant. The user has a first-person view of the environment where the drone flies and may capture video or still images. Same for robots and unmanned vehicles. There is an autopilot and manual control mode. It's possible to automatically send and receive control from another user. Several automatic presets for the camera and manual control. Built-in neural network processes streaming data to detect and recognize objects. Integrated with other applications. Utilizes narrowly directed radio digital beamforming at hopping frequencies for streaming video, images, and for control. The built-in program generator allows the drone to perform the task without operator connection and to mask takeoff and landing points. In conditions of intensive GNSS signal suppression, in addition to the inertial system, a system of ground beacons, including other users, with narrowly directed beams of emitted waves on hopping frequencies can be used.
The Fire Assistant allows the user to detect, recognize, capture, and distribute targets within a team without crossfire and ammunition overruns. Designed to effectively fire for different types of small arms, mortar, and artillery fire, including remote control of robotic turret fire. Dynamically calculates and displays ballistic curve point and muzzle line. Allows for automatic and manual adjustments to the reticle. Captures a hit or miss and makes adjustments for the next shot. Uses combined near and far infrared ranges in day, twilight, and night time. Synthetic vision mode is used for clear display. Allows tracer ammunition not to be used. Effective for moving objects and low-flying aerial targets. Low-cost integration with most types of weapons in use. Integrated with other applications.
The Instant Messaging System allows you to instantly warn the user of danger or send a short command during a tactical task. Integrated with Fire Assistant, Navigation Grid, Gunfire Locator, Drone Detection, Radar Warning, Passive Radar. Avoids shooting at civilians, friendly fire, and crossfire while aiming. Allows you to quickly see the source of the threat when firing toward the user, even when using a silencer. Helps to quickly detect a drone and destroy it at low altitude. When exposed to enemy radar, allows you to quickly change position before impact.
The Multimedia app gives the user options to trigger video, stream, and static image capture in different modes. For videos, these include 5-second videos, short videos, long videos, and videos that are automatically captured by the AI when triggers occur. For photos, there are manual shots and AI-assisted automatic shots. The app also allows you to view other users' media content. Any user can request live video or footage of another user, screenshots of their windows, and view media content related to a location or other event. Low traffic is ensured by 6 and 10 frames per second, as well as reduced resolution and progressive file compression. Convenient smart search and voice control help you find what you need quickly. Dynamic grouping of media content according to user demand.
The Map and Navigation app allows you to use navigation, route tracking, plan a point-to-point and location-based mission, and analyze mission completion. We want to offer a user experience that allows for more frequent use of pre-built solutions for routes and alternate routes according to the mission, updated intelligence, and the best experience of the given route. The user can access descriptions and designations of waypoints, distances, alternate routes to bypass from AI, time intervals, threats, objects like Friend-Foe ID, resources, users in the vicinity, related topics and chats, traction of all route events, importance marks and adding to favorites. The application allows you to quickly find and view quadrants, points according to a specific mission and task points for evacuation and rendezvous points, and combat logistics sectors. This approach saves the user time and attention, while AI analyzes changes and dynamically adapts the route to the user's needs. The app uses mostly voice mode, filter and search capabilities, and hints in the notification window.
The Software Defined Radio Scanning application allows for continuous scanning of radio frequencies in the range of 2 MHz to 8 GHz, self-determining the modulation and wave type, thus identifying the signal and its identity. The user has the ability to not only identify but also localize the source of the radio signal using Radio Direction Finding on demand. AI helps the user to perform all the identification and localization tasks to navigate the radio space without expending effort or requiring deep competence in radio communications. Computer Vision and Computer Audition help the user to gather all available information about radio signals at his location, and, provided the signal is unencrypted or the encryption level is low, to listen to a frequency or view (maybe listen to) a transcript of the conversations with translation into the user's language. The user can share information with other users in chat and in a topic between chats, view session timestamps, and set a tracker to monitor all on-air updates of a given program, and other similar sessions of a given source on other frequencies. The application creates excellent situational awareness capabilities across a wide range of radio frequencies when others are using military and civilian radio equipment: radios, modems, repeaters, phones, probes, beacons, jammers, drones, robots, and other radio sources.
We revealed the top 10 apps for tactical situational awareness. Compass, Intelligent Notifications and Hints, IFF and Navigation Grid, Omnichannel Messenger, Universal Controller for Drones and Robots, Fire Assistant and Night Vision, Instant Messaging, Cameras and Multimedia, Maps and Navigation, RF Scanning and Source Locating. In the next versions of the prototype interface, we will show the capabilities of other applications, like Tasks and Auto-Tasks, Multi-Domain Operations, Mission Planning and Analysing, EOD Scanner, Vitals Body Sensors System, Passive Radar, Wiki, Virtual Mentor, and other. We are open to collaborations.