Public:Graphical User Interface: Difference between revisions

From Wiki Furtherium
 
(247 intermediate revisions by the same user not shown)
Line 1: Line 1:
== Dev (temporary) ==
==Abstract==
{{further|1=[[Public:ARHUDFM Manifesto]],|2=[[Public:Applications]],|3=[[Public:ARHUDFM Features Summary]],|4=[[Public:DoD_Pains]]|5=|6=|7=|8=|9=|10=}}


# Write out scenarios
Augmented Reality Heald-Up Display Fullface Mask (ARHUDFM) is a complex device that is not easy to understand at a first look, because there are little relevant examples to compare. Therefore, we suggest that you first read the information on the [[Public:ARHUDFM Manifesto]] page at the link above.
# Mockups
# Make a storyboard
# Animate elements
# Panning video animations
# Insert a dynamic background (bright day, cloudy day, overcast day, twilight, night, night with bright highlights)


== Interface description ==
This page describes the structure and contents of the GUI (Graphical User Interface) used in the ARHUDFM device.
Интерфейс предназначен для окноа устройства ARHUDFM с FOV 105°h and 33°v, имеет разрешение 2560px по ширине. Видимое поле проецируется LED лучами DLP проектора, предлагающего высокую контрастность и лучшую цветопередачу, с высоким откликом. Постоянный оптический фокус настроен на мнимое расстояние 1900 мм от глаз пользователя, что предотвращает конфликт вергенции и аккомодации, чтобы глаза пользователя не уставали во время долгого использования. Никакие виртуальные зрительные объекты не имеют другой глубины изображения, точно так же, как если пользователь будет наблюдать экран дисплея на расстоянии 1900 мм одновременно с наблюдением остальной картины окружающей среды с фокусом, ориентированным на бесконечность. Это утверждение основано на многочисленных исследованиях и опытах разных лабораторий с большим числом респондентов.


Чтобы представить реальные видимые границы (не фокусное расстояние) экрана, установите дисплей шириной 750-800 мм на расстоянии 550 мм от глаз. Вы отчётливо видите правые и левые части экрана за счёт поворота глаз. Вам не нужно использовать периферическую часть зрения по краям, она остаётся полностью открыта благодаря широкому обзору визора устройства. Лишь только в нижней части при использовании обтюратора дыхательной системы устройства, поле зрение пользователя ограничено примерно на 20° (как в случае использования любого респиратора или при ношении большинства моделей очков).
For a brief description of the functions of each application, please see the [[Public:Applications]] page.


Поскольку интерфейс устройства имеет больше функций, чем обычно используется пользователями компьютеров и мобильных устройств, а особенность устройства такова, чтобы использовать его длительное время в тактических условиях, соблюдаются следующие принципы:
[[File:UI-example-1.png|frameless|950x950px]]


# Как можно меньшая площадь экрана должна мешать обзору реальной окружающей среды в любое время
[[File:UI-example-2.png|frameless|950x950px]]
# Пользователь должен сохранять минимально необходимую часть обзора окружающей среды для ориентирования в пространстве
# Если какой-либо элемент интерфейса непосредственно в данный момент не нужен пользователю, он не должен отображаться
# Пользователь очень быстро должен иметь возможность менять конфигурацию интерфейса
# Пользователь должен иметь возможность одновременно чётко различать элементы интерфейса и окружающую среду при её любой яркости
# Элементы интерфейса не должны быть видны снаружи устройства или создавать эмиссию светового потока
# Лицо пользователя не должно быть подсвечено отражённым излучением, видимым снаружи


== Органы управления интерфейсом ==
''Click on the picture to zoom in''


=== Аппаратные органы управления правой рукой ===
==Interface description==


* Джойстик. Перемещение курсора, управление дроном и роботом.
===Appearance===
* Кнопка включения и выключения устройства
[[File:Pads-100-3.jpg|frameless|950x950px]]
* Кнопка управления режимами наушников (см. Status bar)
* Кнопка "- >". Уменьшение, стрелка вправо, PgDown.
* Кнопка "< +". Увеличение, стрелка влево, PgUp.
* Кнопка C. Click, left control button.
* Кнопка D. Context menu, Shift, right control button.
<gallery mode="slideshow">
File:Joystick buttons right 3.jpg
File:Joystick buttons right 2.jpg
File:Joystick buttons right.jpeg
File:Joystick buttons right 4.jpg
File:Joystick buttons right 5.jpg
</gallery>
 
=== Аппаратные органы управления левой рукой ===
 
* Кнопка включения, выключения и управления ярким прожектором
* Разъём для подключения гарнитуры носимой радиостанции
* Кнопка включения, выключения и управления громкоговорителем
* Кнопка "< -". Уменьшение, стрелка влево, PgDown.
* Кнопка "+ >". Увеличение, стрелка вправо, PgUp.
* Кнопка A. Click, left control button.
* Кнопка B. Context menu, Shift, right control button. Другие назначенные функции.
* Кнопка A + B одновременно.
<gallery mode="slideshow">
File:Joystick buttons left 3.jpg
File:Joystick buttons left 2.jpg
File:Joystick buttons left.jpg
File:Joystick buttons left 4.jpg
File:Joystick buttons left 5.jpg
</gallery>
 
=== Программные органы управления ===
 
* Голосовой ассистент
* Управление жестами
** Захват изображения с помощью трёхсенсорной стереокамеры. Один объектив передаёт изображение на разделительные призмы и далее на 3 сенсора.
** (a) [https://www.arducam.com/64mp-ultra-high-res-camera-raspberry-pi/ DSLR 64 MP] Hawk-eye, diagonal 9.25 mm (7.4 x 5.55 mm), type 1/1.7" (9152 x 6944 px, x16 zoom, manual / autofocus) IR-cut filter removable, view angle 84°
** (b) SenSWIR SONY [https://www.sony-semicon.com/en/products/is/industry/swir.html IMX990] [https://www.sony-semicon.com/files/62/flyer_industry/IMX990_991_Flyer_en.pdf 1.31 MP], diagonal 8.2 mm, type 1/1.2" (1280 x 1024 px), 400-780 + 780-1700 nm
** (с) SONY [https://www.sony-semicon.com/en/products/is/security/security.html STARVIS 2] [https://www.sony-semicon.com/files/62/flyer_security/IMX676-AACR1_Flyer.pdf 12.61 MP] diagonal 10.04 mm, type 1/1.6" (3536 x 3536 px, HDR)
<gallery mode="slideshow">
File:Mask front right view.jpg
File:Mask front left view.jpg
</gallery>
 
== Menu items description ==
Меню имеет 9 функциональных разделов. Принцип управления элементами меню некоторых разделов одинаков, а у некоторых отличается.
 
=== Status bar (STB) ===
Меню статусов находится посередине сверху видимой области и содержит всю главную и часто используемую информацию об использовании функций устройства и приложений. Всего 12 элементов для быстрого выбора и отслеживания имеются в меню статусов, каждый из которых содержит субэлементы, отвечающие за конкретные пресеты функций. Настройки пресетов осуществляются не через меню статусов, а в настройках устройства, служб или приложений. Меню статусов отображается всегда и не скрывается. Каждый элемент расположен в отдельном поле (fading pad).
 
<u>Картинку заменить:</u>
[[File:Status bar@50x.png|left|frameless|1036x1036px]]<br><br>
 
Управление субэлементами выполняется кликом (джойстик, управление жестами) или голосом. Состояния:
* Hover state: 4 угловых сегмента рамки поля
* Click state: рамка по границе поля (эффект анимации, дважды по 100 ms), при каждом клике в установленной последовательности чередуется отображение элементов списка (пресетов)
* Selected (long click >2 s): вертикально расположенный прямоугольник в левом нижнем углу
* Not selected (long click >2 s): вертикально расположенный прямоугольник в левом нижнем углу отсутствует
Отличия при голосовом управлении:
 
* Команда голосовому ассистенту содержит описание требуемого действия и состояния, поэтому выполняется быстрее
* Голосовой ассистент понимает разные интерпретации действий и состояний, поэтому не нужно запоминать голосовые команды наизусть


{| class="wikitable"
{| class="wikitable"
|+
! colspan="2" |Left
! style="width: 15%" | Field
! colspan="2" |Center
! style="width: 15%" | Presets
! colspan="2" |Right
! style="width: 40%" | Description
! style="width: 30%" | Notes
|-
|Time / Date, <br>
Battery / Water, <br>
Spotlight modes
|
* Time indicator
* Date indicator
* Battery level indicator
* Water level indicator
* Spotlight level indicator
|Поле имеет 3 независимых секции: Time / Date, Battery / Water, Spotlight On (+ level) / Off.
 
* Секция "Time / Date" с помощью клика просто переключает отображение для просмотра состояния
* Секция "Battery / Water" с помощью клика переключает отображение уровня запаса основной батареи и уровня запаса воды в питьевой системе для просмотра состояния
* Долгий клик на иконку "Battery" включает режим энергосбережения (жёлтый цвет для включённого состояния)
* Долгий клик на секцию "Spotlight" включает или выключает яркий свет встроенного прожектора. Во включенном режиме прожектора с помощью короткого клика можно изменить уровень яркости: 25%, 50%, 75%, 100%, моргающий режим (SOS). После выключения прожектора запоминается последний использовавшийся режим, который будет использован при повторном включении.
|
* Hover state: 4 угловых сегмента рамки всего поля
* Click state: изменение отображения индикатора
* Selected / Not selected: для Battery and Spotlight (жёлтый цвет для включённого состояния, цвет лазури для выключённого)
|-
|Brightness modes
|
*Auto (AUTO)
*Clear day (CLR)
*Cloudy (CLD)
*Twilight (TWL)
*Dark night (DRK)
*Night lights (NLTS)
*Dazzling day (DZLD)
|Яркость и затемнение полей (fading pads и все окна одновременно, выполняют функцию солнцезащитных очков). Настраиваемые пресеты, по умолчанию:
 
*AUTO - датчик освещённости определяет уровень окружающей освещённости и использует настройки одного из нижеуказанных режимов
*CLR - fading pads 50%, fading windows 25%, projector beam 100%
*CLD - fading pads 25%, fading windows 0%, projector beam 75%
*TWL - fading pads 0%, fading windows 0%, projector beam 75%
*DRK - fading pads 0%, fading windows 0%, projector beam 50%
*NLTS - fading pads 50%, fading windows 0%, projector beam 75%
*DZLD - fading pads 75%, fading windows 75%, projector beam 100%
|''Условие OR при выборе пресетов (выбор одного пресета отменяет выбор ранее выбранного пресета).''
* Определённые окна приложений будут иметь преимущество при выборе затемнения окна для большей контрастности
|-
|Windows modes
|
* Default (DFLT)
* Turn off all windows (OFF)
* Central left window is On, central right window is Off (CLW)
* Central right window is On, central left window is Off (CRW)
* Bottom windows only (BWON)
* Left windows only (LWON)
* Right windows only (RWON)
|В разных ситуациях необходимо позволить пользователю быстро изменить конфигурацию 10 окон одним действием:
 
* DFLT - отображает все активные окна согласно настроенным приоритетам приложений и функций
* OFF - выключает отображение всех окон
* CLW - если использовались по умолчанию оба центральных окна (левый и правый), отключает центральное правое окно, все функции остаются доступны в центральном левом окне
* CRW - как в предыдущем случае, наоборот, отключает центральное левое окно, улучшая обзор окружающей среды
* BWON - выключает слева и справа верхние окна для улучшения обзора ("эффект забрала"), более приоритетные окна переносит в нижнюю область, менее приоритетные окна закрывает, не выключает центральные окна
* LWON - выключает все окна справа ("эффект левого глаза"), более приоритетные окна переносит в левую область, менее приоритетные окна закрывает, не выключает центральные окна
* RWON - выключает все окна слева ("эффект правого глаза"), более приоритетные окна переносит в правую область, менее приоритетные окна закрывает, не выключает центральные окна
|''Условие AND / OR при выборе пресетов (выбор одного пресета в одном случае отменяет, а в другом случае не отменяет выбор ранее выбранного пресета).''
* Пользователь может быстро и гибко управлять конфигурацией окон для каждого окна в отдельности, см. ниже Windows items description
* DFLT, OFF - отменяет выбор любого ранее выбранного пресета
* CLW отменяет CRW и наоборот
* BWON отменяет LWON и RWON
* LWON отменяет RWON и BWON
* RWON отменяет LWON и BWON
|-
|Cameras modes
|
* Frontal HD cam (FHD)
* Rear HD cam (RHD)
* Night / Sky / Fog / Sea vision mode (SWIR)
* Thermal image vision mode (LWIR)
* Silhouette vision mode (SLV)
* Mixed vision mode (MXV) Type 1: FHD + SWIR
* MXV Type 2: SWIR + LWIR
* MXV Type 3: FHD + SWIR + LWIR
* MXV Type 4: FHD + SWIR + LWIR (silhouette mode)
|В зависимости от погодных условий и времени суток, активности пользователя внутри или вне помещений необходим быстрый выбор пресета для эффективного наблюдения, обнаружения и выполнения задач.
 
* FHD - использует диапазон видимого света (400-780 nm) и возможности двух сенсоров, высокое разрешение и широкий динамический диапазон при сильном контрастном освещении
* RHD - включает и выключает камеру заднего обзора
* SWIR -  использует более широкий коротоковолновой диапазон инфракрасного света (780-1700 nm), который применяется для наблюдения отражения окружающего света этого диапазона объектами, расположенными на поверхности воды, в тумане, в дыму, в облаках, в сумерках и ночью
* LWIR - использует длинноволновой диапазон невидимого инфракрасного света (7.5-14 µm), излучающего более тёплыми по отношению к окружающей среде объектами, в основном ночью
* SLV - включает преобразование заполнения в хорошо различимый по отношении к фону режим цветных контуров для контрастных объектов
* MXV - в нескольких типах позволяет использовать возможности четырёх разных сенсоров в разных условиях днём и ночью
|AND / OR
|-
|-
|Audio modes
|LMMP
|
|Left main menu fading pads
* LSPK (loudspeaker On/Off)
|SBP
* L (left On, right Off)
|Status bar fading pads
* R (right On, left Off)
|RSBP
* LR
|Right submenu fading pads
* 25
* 50
* 75
* 100
|Позволяет пользователю быстро включить или выключить громкоговоритель (а также кнопками на левом амбюшоре наушника). Настроить громкость и контролировать его состояние.
 
Также позволяет быстро настраивать режим наушников и громкость (а также кнопками на правом амбюшоре наушника).
 
|AND / OR
|-
|-
|Computer Vision<ref>Wikipedia, [[wikipedia:Outline_of_computer_vision|"Outline Computer Vision"]]</ref><ref>Wikipedia, [[wikipedia:Computer_vision|"Computer Vision"]]</ref> modes
|LQMP
|
|Left quick menu fading pads
* Object detection (OD)
|CLW
* Motion detection (MD)
|Central left window
* Facial detection (FD)
|RQMP
* Facial recognition (FR)
|Right quick menu fading pads
* Optical character recognition (OCR)
* Heat and smoke trace detection (HSTD)
|Пользователю доступны пресеты для быстрого выбора в зависимости от тактических задач. Пресеты могут быть включены несколько одновременно.
 
* OD - на основе обученной нейронной сети позволяет обнаруживать людей, технику, дроны, искусственные сооружения, выделяя их на экране и производя измерения дистанции, высоты над землей, скорости, курсового направления и геопозиции
* MD - помогает обнаруживать движущиеся объекты, людей и техника, игнорируя полёты птиц и насекомых, движение облаков. Режим MD рекомендуется использовать совместно с режимом Radio Frequency Drone Detection (RFDD) and Computer Hearing Detect noises of aircraft motor (DAM)
* FD - в т.ч. с помощью LWIR сенсора камеры помогает обнаруживать лица людей
* FR - с помощью нейронной сети при наличии обмена с сервером позволяет распознавать лица людей для идентификации
* OCR - позволяет распознавать текст и другие графические символы для последующего перевода и документирования
* HSTD - позволяет обнаруживать траектории летательных аппаратов и ракет, артиллерийский и миномётный огонь из закрытых позиций
|AND
|-
|-
|Computer Hearing modes
|LFSP
|
|Left features sidebar fading pads
* Detect noises of aircraft motor (DAM)
|CRW
* Exclude sounds of nature (ENAT)
|Central right window
* Eliminate echo (ECHO)
|RFSP
* Detect noises of human activity (DHUM)
|Right features sidebar fading pads
* Limit the sound threshold (STHR)
|Пользователю доступны пресеты для быстрого выбора в зависимости от тактических задач. Пресеты могут быть включены несколько одновременно.
 
* DAM Режим DAM рекомендуется использовать совместно с режимом Radio Frequency Drone Detection (RFDD) and Computer Vision Motion Detection (MD)
* ENAT
* ECHO
* DHUM
* STHR
|
|-
|-
|Radio detection modes
|LUW
|
|Left Upper window
* Identification Friend-or-Foe (IFF)
|CWJP
* Radio Direction Finding (RDF)<ref>Wikipedia, [[wikipedia:Direction_finding|"Radio direction finding"]]</ref>
|Central window joystick pads
* Radio Frequency Drone Detection (RFDD)<ref name=":0">AARTOS, [https://drone-detection-system.com/sensor-types-overview/detection-rf/#:~:text=AARTOS%E2%84%A2%20RF%20Detection.,by%20comparing%20different%20frequency%20patterns. "RF Drone Detection"], [https://drone-detection-system.com/sensor-types-overview/detection-rf/#antennas "Antennas"]</ref>
|RUW
* Explosive Ordnance Disposal (EOD)
|Right Upper window
* Radar Warning Receiver (RWR)<ref>Wikipedia, [[wikipedia:List_of_radar_types|"List of radar types"]], [[wikipedia:Counter-battery_radar|"Counter-battery radar"]]</ref>
|Пользователю доступны пресеты для быстрого выбора в зависимости от тактических задач. Пресеты могут быть включены несколько одновременно.
 
* IFF - включает транспондер системы Identificatiin Friend-or-foe, которая в ответ на зашифрованный сигнал опроса, принимаемый на одной частоте, отправляет зашифрованный пакет сообщения на другой частоте, содержащий подтверждение "Friend", Id, позывной и позицию. В зависимости от включённого другого режима "Stealth" будет отправлять ответное сообщение на разных частотах, в разных сетях и с разной мощностью (на ограниченную дистанцию) или не будет отправлять сообщение.  В другую сторону транспондер с указанным интервалом на определённых частотах формирует и отправляет сигналы опроса посредством всенаправленной антенны или направленной антенны (круговая диаграмма направленности может быть ограничена отражательной решёткой). Данная функция отображает на навигационной сетке одного из экранов позиции пользователей, с подтверждением "Friend"
* RDF - включает радиопеленг принимаемых радиочастот, идентифицируемых как потенциально содержащих угрозу (радары, системы EW&SIGINT, ECM) или определяемые как источник несущей радиочастоты (аналоговый или цифровой сигнал) для коммуникации. С помощью триангуляции в коллаборации с аналогичным устройством другого пользователя в сети P2P (на короткой дистанции с ним) определяет направление и расстояние. Без помощи другого устройства определяет только направление (курс).  В соответствии с установленным алгоритмом может отправлять зашифрованный сигнал опроса для системы IFF. В условиях искажения или подавления радиосигналов навигационных спутниковых систем используется для радионавигации по наземным радиомаякам, работающим в других диапазонах частот, в том числе в радиовещательных диапазонах FM, TV и мобильной связи
* RFDD - enables the mode of radio frequency detector used to detect the presence of RF waves in physical transmission mediums. The system uses these RF Detectors to detect drones and drone pilots. RFDD also uses AI to identify the type of threat by comparing different frequency patterns. The system can easily distinguish drones from common RF signals by using learned patterns and can identify almost all types of threats as well as the location of the drone pilot.  Компактная всенаправленная мобильная антенна располагается за спиной пользователя и имеет диапазон 9 kHz - 8 GHz, и дистанцию обнаружения до 3 км (conical or dome range). Мобильная переносная антенна  Данная функция отображает на навигационной сетке и/или на карте местности экранов интерфейса позиции идентифицированного RPA (UAV) и его оператора. <br />Режим RFDD - частный случай функции RDF, его рекомендуется использовать совместно с режимом Computer Vision Motion detection (MD) и Computer Hearing Detect noises of aircraft motor (DAM)
* EOD - использует внешнее устройство Metall Re-radiation Radar (METR), через соединение посредством Bluetooth
* RWR - включает режим обнаружения облучения со стороны радаров ЗРК и РЛС контр-батарейной борьбы<ref>Wikipedia, [[wikipedia:Counter-battery_radar|"Counter-battery radar"]]</ref>, отображает на экране в окне с навигационной сеткой и/или картой местоположение данных радаров
|RWR mode является незаменимым при выполнении тактических задач миномётного и артиллерийского огня
|-
|-
|Firing assistance modes
|LTAW
|
|Left Top A window
* Fire on ground fixed targets (GF)
|CWBP
* Fire on ground moving targets (GM)
|Central window buttons pads
* Fire on aerial moving targets (AM)
|RTAW
* Mountain fire on fixed targets (MF)
|Right Top A window
* Mountain fire on moving targets (MM)
|
|
|-
|-
|Stealth modes
|LTBW
|Left Top B window
|
|
* IFF visible only (IFF)
* Short distance visible only (SD)
* Zero emission (FULL)
* OFF
|Данный режим необходим для ограничения видимости средствами SIGINT противника.
* IFF - блокируются все радиопередачи (в т.ч. исходящие сигналы опроса IFF) за исключением зашифрованных ответных сообщений транспондера системы Identificatiin Friend-or-foe, в том числе маскируя передачу ответного сообщения в диапазоне частот фонового шума радиовещательного диапазона (FM, TV) и используя более длительные паузы в интервалах ответов на сигналы опроса (возможны другие стратегии радиообмена, чтобы оставаться незамеченным)
* SD - используются только сети ближнего радиуса действия, например, Bluetooth, Wi-Fi Direct (P2P) и UHF с ограниченной мощностью передачи на короткие расстояния
* FULL - все радиопередачи блокированы, только приём (полностью пассивный режим), режим IFF автоматически отключается (и наоборот, при смене режима Stealth на другой, режим IFF включается снова)
* OFF - не ограничивает радиопередачу
|
|
|RTBW
|Right Top B window
|-
|-
|Vitals body tracking modes
|LBAW
|
|Left Bottom A window
* Set 1 (S1)
* Set 2 (S3)
* Set 3 (S3)
|
|
|
|
|RBAW
|Right Bottom A window
|-
|-
|Networks modes
|LBBW
|Left Bottom B window
|
|
|Signal levels, upload / download transmission status
|
|
|RBBW
|Right Bottom B window
|}
|}


=== Left main menu (LMM) and Right Submenu (RSB) ===
===Features===
The interface is designed for the screen of the ARHUDFM device with FOV 105°h (stereo overlap) and 33°v, has a resolution of 3840px in width and 1200 px in hight.


Главное меню (LMM) находится слева сверху видимой области и содержит список разделов. Всего 7 элементов для быстрого выбора в одном ряду. Для выбора следующего ряда используются навигационные стрелки справа. Главное меню отображается только при наведении курсора или при голосовом вызове. При неактивности скрывается через 15 сек. Каждый элемент расположен в отдельном поле (fading pad). Показываются только поля, отображающие раздел.
{{#info-tooltip: More info}} <span style="background-color:#fff3bc">''Normal human stereoscopic binocular vision is 180° horizontally, up 55°, down 60°.''</span><ref>Wikipedia, [[wikipedia:Field_of_view|"Field of view"]]</ref> <span style="background-color:#fff3bc">''If the area of ​​peripheral vision important for situational awareness is excluded, a comfortable field of view, especially if a person wears optic corrective glasses, will be 105-115° horizontally, 20° up and 25° down. Since the airway obturator of the mask from below is an obstacle to vision, the field of view of a person wearing a mask from below is less than usual (however, pilots of combat aircraft have sufficient visibility). Horizontally, the mask user has a complete view of the entire field of view, including the peripheral part, which is important.''</span>


Правое субменю (RSB) находится сверху справа и раскрывает второй более низкий уровень элементов главного меню. Всего 7 элементов в одном ряду. Для навигации используются стрелки слева. Правое субменю отображается только при активном состоянии одного из пунктов главного меню слева (LMM) или при голосовом вызове непосредственно пункта субменю. При неактивности скрывается одновременно с главным меню через 15 сек. Каждый элемент расположен в отдельном поле (fading pad). Показываются только поля, отображающие раздел.
The visible field is projected by the LED beams of a DLP projector offering high contrast and better color reproduction with high response.


<u>Картинку вставить:</u>
{{#info-tooltip: More info}} <span style="background-color:#fff3bc">''Unlike the harmful effects of the blue light spectrum (light colors contain a lot of blue) emitted by the LED screen of a monitor or mobile device, which causes fatigue, headaches and sleep problems when exposed for a long time, the reflected light of a DLP projector (and other types of projectors also) does not have such disadvantages. In addition, in the ARHUDFM device, the principle of displaying the interface resembles the night mode (dark background, light graphic symbols). These conditions for the user create the possibility of round-the-clock work without stress.''</span>


The constant optical focus is set to an apparent distance of 1900 mm (75 in) from the user's eyes, which prevents conflict of vergence and accommodation so that the user's eyes do not get tired during long-term use. No virtual visual objects have a different image depth, just as if the user were to observe the display screen at a distance of 1900 mm while observing the rest of the environment with the focus oriented to infinity. This statement is based on numerous studies and experiments of different laboratories with a large number of respondents.


Управление субэлементами выполняется кликом (джойстик, управление жестами) или голосом. Состояния:
{{#info-tooltip: More info}} <span style="background-color:#fff3bc">''The tension of the muscles of the eye due to the close distance to the object in question causes fatigue, including being one of the causes of the development of myopia. Neck muscle tension and stoop due to the need to focus on a fixed part of field of view for a long time is also an unfavorable factor. This applies to all cases of human work with the screens of laptops, mobile devices, reading paper books and documents.''</span>
* Hover state: 4 угловых сегмента рамки поля
* Click state: рамка по границе поля (эффект анимации, дважды по 100 ms)
* Selected (long click >2 s): горизонтально расположенные два прямоугольника справа и слева от надписи
* Not selected (long click >2 s): горизонтально расположенные два прямоугольника справа и слева от надписи отсутствуют
Отличия при голосовом управлении:


* Команда голосовому ассистенту содержит описание требуемого действия и состояния, поэтому выполняется быстрее
To imagine the actual visible edges (<u>not the focal length</u>) of the screen, sit in front of a 65" or 1440mm (57.3 inches x 32.9 inches) TV screen at a distance of 22" or 550mm from your eyes. You can clearly see the right and left sides of the screen by turning your eyes. You don't need to use the peripheral part of the vision at the edges, it remains completely open due to the wide field of view of the device's visor. Only in the lower part, when using the airway obturator of the device, the field of view of the user is limited to about 20°, as is the case with any respirator or when wearing most models of glasses. Glasses tend to shrink the effective field of view to somewhere between 90 and 115 degrees horizontally and 35-45 degrees vertically, depending on the width and hight of the glasses and their proximity to the eyes.
* Голосовой ассистент понимает разные интерпретации действий и состояний, поэтому не нужно запоминать голосовые команды наизусть
* При голосовом вызове показывается не всё меню целиком, а соответствующие пункты главного меню и субменю
* Пользователь может вызвать голосом отображение всего меню целиком
{| class="wikitable"
|+
! style="width: 15%" | LMM
! style="width: 15%" | RSB
! style="width: 40%" | Description
! style="width: 30%" | Notice
|-
|Messenger (MSG)
|
* Instant messaging system (IMSG)
* Multichannel chat (CHAT)
* eMail (MAIL)
|Включает окна приложений для коммуникаций. Приложение позволяет принимать и отправлять сообщения (в т.ч. с запросом ответа). Сообщения содержат текст, изображения (в т.ч. скриншот), видео, аудио, файл. Позволяет видеть доступных абонентов, непросмотренные сообщения, исходящие и входящие сообщения без ответа. Позволяет преобразовывать голос в текст и, наоборот, озвучивать текст. Позволяет настраивать каналы и приоритеты.
Instant messaging system распознаёт жесты и голосовые команды для отправки участникам группы или персонально иконографические символы, по примеру дорожных знаков. Чаще всего применяется в тактических задачах штурмовыми подразделениями, разведгруппами и снайперами.
|
* В правом верхнем углу отображается счётчик уведомлений о сообщениях, требующих ответа
* В левом нижнем углу отображается число непросмотренных сообщений
|-
|Tasks (TSK)
|
* Overdue (OVDU)
* Ongoing (ONGO)
* Assisting (ASST)
* Set by me (SBME)
* Following (FLWG)
* Comments (CMNT)
* Done (DONE)
|Система управления задачами позволяет планировать и контролировать срок, точность, результаты, эффективность выполнения задач. Содержит описание, чек-лист, дедлайн, фактическое время выполнения и затраченное время (в т.ч. автотрекинг завершения и отсчёт затраченного времени), уведомление о текущем статусе, геопозицию в момент завершения, артефакты подтверждения выполнения задачи, вложения, комментарии.
|
* В правом верхнем углу отображается счётчик уведомлений о просроченных задачах и с приближающимся дедлайном
* В левом нижнем углу отображается число задач на сегодня
|-
|Calendar (CAL)
|
* Day (DAY)
* Week (WEEK)
* Month (MNTH)
* Year (YEAR)
|Календарь событий позволяет заранее планировать и согласовывать события, требующие определённого регламентов времени: коллективные онлайн и офлайн коммуникации, собрания, учебные семинары, командировки.
|
* В правом верхнем углу отображается счётчик уведомлений о просроченных событиях и с приближающимся сроком
* В левом нижнем углу отображается число событий на сегодня
|-
|Workgroups (WGR)
|
* Tactical (TAC)
* ISR
* Fire support (FSUP)
* Fast air (FAIR)
* Medical assist (MAS)
* Evacuation (EVAC)
* Logistic (LOG)
|Субменю содержит фильтры для групп.
Можно выбрать участника или группу в соответствующем разделе для коммуникаций, обмена данными, отправки или запроса позиции. Элемент CDI (Cross-Domain Interaction).
|
* В правом верхнем углу отображается количество доступных участников групп


* В левом нижнем углу отображается число активных рабочих групп, в которых состоит пользователь
{{#info-tooltip: More info}} <span style="background-color:#fff3bc">''We've added these comments because most people don't have experience with these kinds of AR devices yet. Microsoft IVAS''</span> <ref>Breaking Defense, [https://breakingdefense.com/2024/08/army-open-to-replacing-microsoft-as-ivas-prime-under-ivas-next-industry-sources-say/ Army open to replacing Microsoft as prime under ‘IVAS Next,’ industry sources say] (Aug 15, 2024)</ref><span style="background-color:#fff3bc">''(Hololens 2) uses holographic optics, thick lenses and FOV 43°h 28°v, Magic Leap has similar technology to Microsoft and FOV 45°h 55°v. Apple Vision Pro is a VR device (opaque LED display) like the Meta (Oculus) Quest - FOV 90°h 98°v''</span><ref>GitHub, Pimax Forum, [https://risa2000.github.io/hmdgdb/ "HMD Geometry Database"]</ref><span style="background-color:#fff3bc">'', HTC Vive, SONY Playstation, etc. None of these technologies or devices are like ARHUDFM and when used in tactical tasks carry many significant risks. [[Public:ARHUDFM FAQ#how it's similar to the competitors' products|More about it here.]]''</span>
|-
|Applications (APP)
|
* Drone control (RPAC)
* Robot control (RBRC)
* Fire turret remote control (FTRC)
* Passive covert surveillance radar (PCSR)
* Active phased array radar remote control (APAR)
* Metal re-radiation radar (METR)
* SDR Scan
* SDR 2-way
* Cryptologic control
* Multimedia recorder and player
* Translator
* Virtual mentor
|Drone control, Robot control, Fire turret control приложения для управления RPA, UAV, cobots в соответствии с протоколом связи и функциями, предоставленными производителем для интеграторов. Включает ручное управление через радиосигнал, автоматические команды данной модели, модель управления с помощью ИИ. Интеграция настраивается в разделе меню Devices.


Passive covert surveillance radar (PCSR) - приложение для внешнего устройства, которое устанавливается на устройство сверху в NMG mount и подключается в разъём USB. Тип радара, не имеющего собственного излучения, который обнаруживает и сопровождает объекты, обрабатывая отражения от не взаимодействующих источников освещения в окружающей среде, таких как сигналы коммерческого вещания и связи. Они позволяют рассчитать местоположение, направление и скорость объекта. В некоторых случаях можно использовать несколько передатчиков и/или приемников для выполнения нескольких независимых измерений бистатической дальности, доплеровского сдвига и пеленга и, следовательно, значительно повысить точность окончательного пути.
The main feature of Augmented Reality devices is that a person can only see lighter areas on a darker screen background. The nature of vision is that a person sees not objects, but the light reflected from them. Those, can see a high-contrast image in a darkened room (Microsoft uses a tinted visor) or at night, but see almost nothing against a bright sky, on a sunny day, with strong reflections from snow or building walls, when looking at the sun. A person will not be able to see dark areas on a light background in principle, since this contradicts the physics of light (dark areas are the absence of light). The ARHUDFM solves this problem by using "smart windows" - the interface contains 10 large and 56 small fading pads that instantly change their transparency from 0% (opaque black) to 100% (fully transparent) depending on the ambient light or the mode selected by the user.


Active phased array radar remote control (APAR) - приложение для удалённого управления малозаметным мобильным активным (излучающим) радаром с активной фазированной решёткой и обмена с ним данными. Твердотельные приёмо-передаточные модули радара направлены в разные направления без перемещения антенны. См. Northrop Grumman AN/ZPY-1 STARLite Small Tactical Radar - Lightweight.
===Principles===
Since the user interface of the ARHUDFM device has more functions than is usually used by users of computers and mobile devices, and the device is such that it can be used for a long time in tactical conditions, the following principles are observed:


Metal re-radiation radar (METR)
#As small screen area as possible should obstruct the view of the actual visual environment at all times
#The user must maintain the minimum necessary view of the visual environment for orientation in space
#If any element of the interface is not directly needed by the user at the moment, it should not be displayed on the screen
#The user should be able to change the interface configuration very quickly
#The user must be able to simultaneously clearly distinguish between interface elements and the visual environment at any brightness.
#Interface elements must not be visible from the outside of the device or create light emission to the outside
#The user's face must not be illuminated by reflected radiation, must not be visible from the outside at the night
#The audio environment should not have an attenuation greater than 10 dB SPL, except when using the noise reduction features


SDR Scan - приложение для сканирования, декодирования, анализа, прослушивания (аналоговых и незашифрованных сигналов), ретрансляции радиочастот в диапазоне 1 MHz - 6 GHz, включая диапазоны ТВ и радиовещания, радиолюбительские диапазоны, РЛС, авианавигации, радиомаяки, частоты мобильной связи, беспроводных сетей.
==Interface controls==
[[File:ARHUDFM_multimedia_location.jpg|alt=ARHUDFM multimedia location|frameless|950x950px]]


SDR 2-way - приложение для управления коммуникациями в разных частотных диапазонах: HF (2-30 MHz), VHF low (30-66 MHz), VHF high (136-174 MHz), UHF (230-400, 400-470, 790-870, 1200-1260 MHz, incl. HAM, LPD, PMR 446, ISM). (!) Сверить частоты по спецификациям!!
===Right hand hardware controls===


Cryptologic control - приложение для управление ключами и шифрованием.
*Joystick. Cursor movement, drone and robot control
*Device on/off button
*Headphone mode control button (see Status bar)
*Button "- >". Decrease, right arrow, PgDown.
*Button "< +". Increase, left arrow, PgUp.
*Button C. Click, left control button
*Button D. Context menu, Shift, right control button
<gallery mode="slideshow">
File:Joystick buttons right 3.jpg
File:Joystick buttons right 2.jpg
File:Joystick buttons right.jpeg
File:Joystick buttons right 4.jpg
File:Joystick buttons right 5.jpg
</gallery>


Multimedia recorder and player - приложение для записи видео (в т.ч. экранного), аудио (в т.ч. с внешних микрофонов и из приложений), фото и для просмотра файлов мультимедиа, в т.ч. быстрый поиск фото. Записывает теги и примечания для каталогизации и поиска.
===Left hand hardware controls===


Translator
*Headlamp (Spotlight) on / off button
*Headset connector for handheld portable / manpack radio (also ground / vehicular radio headset cable)
*Loudspeaker on / off and control button
*Button "< -". Decrease, left arrow, PgDown
*Button "+ >". Increase, right arrow, PgUp
*Button A. Click, left control button, headset PTT button for radio
*Button B. Context menu, Shift, right control button, Photo, other assigned functions
*Buttons A+B simultaneously start / stop video record
<gallery mode="slideshow">
File:Joystick buttons left 3.jpg
File:Joystick buttons left 2.jpg
File:Joystick buttons left.jpg
File:Joystick buttons left 4.jpg
File:Joystick buttons left 5.jpg
</gallery>


Virtual mentor
===Software controls===
|
|-
|Devices (DVC)
|
|
|
|-
|Maps (MAP)
|
|
|
|-
|Networks (NET)
|
|
|
|-
|Wiki (WIKI)
|
|
|
|-
|File explorer (FILE)
|
|
|
|-
|Services (SVC)
|
|
|
|-
|Settings (SET)
|
|
|
|}


=== Left Quick menu (LQM) ===
*Voice assistant
**Machine learning (AI) algorithms are used to recognize the meaning of user commands, not necessarily the exact pronunciation of the voice command, including the ability to adapt to the voice and pronunciation of the user
*Gesture control
**The stereo camera captures the image of the hands and recognizes the user's gestures (more details on the [[Hand Tracking]] page)
**Gesture library constantly updated, Machine Learning allows the user to create custom gestures
**Gestures can indicate not only the state, but also the dynamics, for example, smoothly change the volume level, brightness, etc.
**Capturing and recognizing fingers allows to use software interface controls, including scrollbars, buttons (and a virtual keyboard if necessary), swipe sideways and up or down, scale and rotate screens inside a window, hide and move windows
<gallery mode="slideshow">
File:Mask front right view.jpg
File:Mask front left view.jpg
</gallery>


=== Right Quick menu (RQM) ===
==Perception hardware==
The advantage of this wearable and inexpensive device for tactical use by almost every military person is the ability ''to perceive light, sound and radio waves, inaccessible to humans.''


=== Left Features sidebar (LFSB) ===
===Cameras===
*Image capture with a three-sensor front stereo camera. One objective lens transmits the image to the separation prisms and then to 3 sensors: DSLR IR-cut 4K/8K/12K UHD, SenSWIR, HDR
*Separate camera in the range of LWIR (thermal image vision)
*Separate rear view camera with extended visible light and SWIR
*Folded optical lenses design
*Built-in Speed ​​Booster reduces focal length and increases aperture for individual sensors
*Built-in teleconverter, on the contrary, increases the focal length for other sensors, increasing the image of distant objects
*IR filter laser protection lens coating for 700-1080 nm (against systems for remote detection of optical and optoelectronic devices)
*{{#info-tooltip: More info}} <span style="background-color:#fff3bc">''Infrared and laser light sources are not used in this device, because this demasks the user''</span>


=== Right Features sidebar (RFSB) ===
Virtual remote control tools


* Фото и видео кнопки управления
[[File:Speedbooster-1.jpg|frameless|457x457px]][[File:Speedbuster.jpg|frameless|408x408px]]
* Перелистывание
* Навигация
* Управление дроном, роботом, беспилотным транспортом


== Window items description ==
===Microphones===
Окна приложений и функций располагаются в большей и наилучшей видимой области. Всего 12 независимых окон (8 больших 1.78:1, 2 больших 1.20:1, 2 малых 19.86:1), каждое из которых содержит субэлементы управления, когда окно выделено с помощью клика или голосом (selected state). Не выделенное окно является пассивным окном, которое отображает только графику приложения, элементы управления окном скрыты, элементы управления приложением скрыты. Окна разных прилоожений имеют разный приоритет отображения, который настраивается в настройках системы для каждого приложения. В зависимости от выбранного пресета в Status bar (STB) конфигурации отображаемых окон могут быть быстро и гибко изменены пользователем.
*Built-in MEMS (Micro-Electro-Mechanical-Systems) microphone (1) in mask obturator airway to transmit the user's voice
**If the lower part of the mask is not used, a boom microphone (2) with a windproof pad on the flexible goosneck is connected
*19 external MEMS cardioid microphones, "flat/dome" acoustic arrays allow to perceive sound waves in a wide range of frequencies, including those inaudible to humans, from very low to very high, used in Computer Audition modes ([[Public:Applications#CAC (Computer Audition control)|CAC]])
**incl. [[Gunfire locator|Gunfire Locator]]
**incl. Active noise reduction ([[Public:Applications#MMC (Multimedia control)|MMC]])
*The super-cardioiod and ultra-cardioid microphones with a narrow directivity pattern on the front of the mask allow to accurately determine the source of the sound wave
*{{#info-tooltip: More info}} <span style="background-color:#fff3bc">''2 insulating layers, airway obturator and seal around face make the user's voice almost inaudible from the outside''</span>


<u>Картинка</u>
===Radio antennas===
*Built-in transmit-receive antennas in the ranges of the near radius of communications (Bluetooth, Wi-Fi, LTE, 5G)
*Integrated manpack antennas for communications in the VHF, UHF, UHF SAT, MUOS, L/S bands
*Integrated manpack antennas for analyzing and listening to the frequency ranges 2 MHz - 8 GHz
*{{#info-tooltip: More info}} <span style="background-color:#fff3bc">''Not every user needs a separate antenna or a set of several antennas with different characteristics, using the P2P network within the group, packets of messages and received data can be exchanged and routed''</span>
*Integrated passive radar antenna with active phased array (installed in NVG mount)
*Integrated handheld portable short-range active metal re-radiation radar antenna
*Integrated receiving antenna for radar warning system
*Integrated antenna for remote control of a drone or robot
*Integrated antenna for close-range remote control of an active phased array radar (portable or vehicle-mounted)
*Software-defined (reconfigurable) antenna (installed in NVG mount and the other two via the picatinny rails on the sides of the helmet)
*{{#info-tooltip: More info}} <span style="background-color:#fff3bc">''The software-defined antenna is capable of combining the functions of most integrated antennas''</span>




{{#info-tooltip: More info}} <span style="background-color:#fff3bc">''The specific is that when using a separate optical lens for each sensor on the left and right, there is a problem of parasitic multi-angle, which will have to be constantly leveled by software, which affects the accuracy of binocular stereo vision. If in a smartphone this is not critical, and there may be 4-8 cameras with their own optics, then for tactical tasks this is of great difficulty. In this case, on the left and right, it is necessary to accurately hold the horizontal distance between the lines of sight for each pair of sensors and position them vertically, and then programmatically compensate for the vertical shift in order to reproduce a single optical axis for the left and right channels. In addition, the design of the device should allow this to be done without difficulty, including taking into account the angle of the field of view of the optics and solving the problem of shadowing.''</span>


Управление субэлементами выполняется кликом (джойстик, управление жестами) или голосом. Состояния:
==Menu items description==
* Hover state: частая пунктирная линия вдоль рамки поля
{{further|1=[[Public:Applications]],|2=[[Public:Voice User Interface]]|3=|4=|5=|6=|7=|8=|9=|10=}}
* Click state: рамка по границе поля (эффект анимации, дважды по 100 ms)
* Selected (long click >2 s): редкая пунктирная линия вдоль рамки поля
* Not selected (long click >2 s): пунктирная линия отсутствует
Отличия при голосовом управлении:


* Команда голосовому ассистенту содержит описание требуемого действия и состояния, поэтому выполняется быстрее
The menu has 7 functional sections:
* Голосовой ассистент понимает разные интерпретации действий и состояний, поэтому не нужно запоминать голосовые команды наизусть
Пользователь может быстро и гибко управлять конфигурацией окон для каждого окна в отдельности:


*Пользователь может принудительно закрыть любое окно в любое время, выделив нужное окно (selected state), нажав на иконку "закрыть окно" (приложение остаётся в фоновом режиме, для обратного действия кликнуть на иконку в меню быстрого выбора)
*Status bar (SB)
* Пользователь может увеличить левое или правое большое центральное окно на всю область центрального окна (объединённое окно 2.40:1), выделив нужное окно (selected state), нажав на иконку "увеличить окно"
*Left main menu (LMM)
* Пользователь может увеличить большое осно слева или справа на всю левую или правую область окна (объединённое окно 1.78:1 x2), выделив нужное окно (selected state), нажав на иконку "увеличить окно"
*Right submenu (RSB)
* При нажатии на иконку "уменьшить окно" окно возвращается в исходное состояние
*Left quick menu (LQM)
* Иконка "сместить окно влево" смещает его влево, затем вверх направо, затем влево, меняя расположение других окон
*Right quick menu (RQM)
* Иконка "сместить окно вправо" смещает окно вправо, затем вниз налево, затем вправо, меняя расположение других окон
*Left features sidebar (LFS)
* Иконка "поделиться экраном" позволяет отправить скриншот окна или включить трансляцию данного окна для другого пользователя
*Right features sidebar (RFS)


Смещение окон влево и вправо:
The principle of managing menu items of some sections is the same, and some are different.


* Общее правило "слева направо, сверху вниз" (список перемещения 10 больших окон):
===Status bar (SB)===
** LTAW - left top window A
The status bar is located in the top middle of the visible area and contains all the main and frequently used information about the use of device functions and applications.
** LTBW - left top window B
[[File:SB sceme.png|center|frameless|950x950px]]
** LBAW - left bottom window A
A total of 12 items for quick selection and tracking are available in the status bar, each of which contains sub-elements responsible for specific function presets. Preset settings are carried out not through the status bar, but in the settings of services or applications. The status bar is always displayed and is not hidden. Each element is located in a separate field (fading pad).<br>
** LBBW - left bottom window B
[[File:Status bar menu v1.0.png|left|frameless|1036x1036px]]<br><br>
** CLW - central left window
<br>
** CRW - central right window
<br>
** RTAW - left top window A
<br>
** RTBW - left top window B
The sub-elements of the status bar are controlled by clicking (joystick, gesture control) or by voice (the result corresponds to the click). Default states:
** RBAW - left bottom window A
** RBBW - left bottom window B
* Если активное окно расположено в левой части и он перемещается влево, он перемещается выше по списку
* Если активное окно расположено в левой части и он перемещается вправо, он перемещается ниже по списку, сначала в центр видимой области, затем в правую часть
* Если место, куда перемещается активное окно не занято другим окном, другие окна не меняют своего положения
* Другой отображаемое окно, на место которого смещается активное окно вниз по списку, автоматически перемещается выше по списку и занимает предыдущее место смещаемого активного окна
* Другой отображаемое окно, на место которого смещается активное окно вверх по списку, автоматически перемещается ниже по списку и занимает предыдущее место смещаемого активного окна
* Обычно отображаются менее 10 больших окон, поэтому смещение активного окна не приводит с смещению большинства других окон
* Если отображаются все 10 больших окон, смещение активного окна на несколько позиций в списке вызывает последовательное автоматическое временное смещение соседнего окна, который затем снова возвращается на предыдущее место
* Если окно максимизировано, оно автоматически минимизируется и перемещается по общему правилу, при необходимости его нужно максимизирован снова
* Пользователь может выделить два или более окон одновременно, удерживая клавишу D (рядом с джойстиком) амбюшора правого наушника (аналогично правой клавиши мыши)
* Выделив окно и удерживая клавишу C (аналогично левой клавиши мыши) амбюшора правого наушника пользователь может переместить окно или несколько окон одновременно одним действием с помощью джойстика - в этом случае, если перемещается группа окон, они будут располагаться последовательно рядом по списку (даже если в предыдущем их местоложении они не были расположены последовательно рядом по списку)
* Малые окна перемещаются только влево или вправо на место аналогичного малого окна
* Если малое окно перемещается вправо, другое окно перемещается влево (меняются местами)
* Если приложение запускает малое окно в то время, когда оба малых окна отображают информацию других приложений, тогда окно с приложением, имеющим наименьший приоритет, скрывается в меню быстрого выбора
* Если одно малое окно закрывается, на его месте ничего не отображается, для отображения на этом месте окна другого приложения необходимо кликнуть на него в меню быстрого выбора или в главном меню
* Если приложение запускает большое окно, которое имеет больший приоритет для уже занятого окна, тогда окно с меньшим приоритетом перемещается в другое место, как предусмотрено правилами приоритета окон и приложений. При закрытии окна с большим приоритетом, конфигурация окон возвращается в предыдущее состояние
* Если приложение запускает большое окно, когда нет свободного места для отображения окон, окно с наименьшим приоритетом скрывается автоматически в меню быстрого выбора. При закрытии одного из окон с большим приоритетом, восстанавливается предыдущее состояние отображения окон. При необходимости отображения окна с меньшим приоритетом, необходимо освободить место для него, свернув один из окон в меню быстрого выбора


<u>Прокрутка окна на (4/5 высоты окна или в строках - настраивается индивидуально)</u> выполняется иконками вверх и вниз или кнопками джойстика "< +" и "- >" снизу амбюшора правого или левого наушника (аналогично клавишам мыши PageUp, PageDown). Также плавная прокрутка окна джойстиком, голосовой командой или жестом (в т.ч. виртуальным джойстиком или обособленным жестом).
*''Hover state:'' 4 corner segments of the field frame (in the above example in the "Radio Detection modes" field with the "IFF" function)
*''Click state:'' frame on the border of the field (animation effect, twice 100 ms), with each click sequenced display of list elements (presets)
*''Selected'' (long click >2 s): vertically positioned rectangle in the lower left corner
*''Not selected'' (long click >2 s): no vertical rectangle in the lower left corner


Элементы управления (иконки управления окном, функциональные программные кнопки интерфейса приложения, расположенные на Sidebar Left or Sidebar Right, виртуальные джойстики) относятся только к активному (selected) окну. Для пассивного окна (not selected) они не отображаются. 
Differences in voice control:


Отдельно для иконок управления окном - после того, как окно стало активным (selected), иконки управления окном отображаются в течение 15 с, после чего исчезают. Для их повторного отображение необходимо снова выделить данное окно. Пунктирная рамка выделения активного окна отображается в течение всего времени активного состояния окна.
*The command to the voice assistant contains a description of the desired action and state, so it is faster
*The voice assistant understands different interpretations of actions and states, so there is no need to memorize voice commands


 
===SB indication and change of display===
! Кроме того, принудительное использование некоторых окон может выполнить функцию солнцезащитного козырька тогда, когда солнце находится низко над горизонтом на линии визирования. Пользователь может смещать окно в нужную область и перекрывать ослепляющий вид на солнце, не затемняя всю область визирования.
 
=== Left Position window (LPW) ===
Обычно используется долговременно.
 
# Компас и азимут (app priority 1)
 
=== Left top A window (LTAW) ===
Используется при необходимости, не рекомендуется во время интенсивного боя, чтобы не ограничивать видимость окружающей среды.
 
# Карта и навигатор вместе (app priority 1, window priority 1)
# Навигатор отдельно (app priority 1, window priority 2)
# Карта отдельно (app priority 1, window priority 3)
 
=== Left top B window (LTBW) ===
Обычно используется кратковременно, чтобы не ограничивать видимость окружающей среды.
 
# Навигатор отдельно (app priority 1, window priority 1)
# Tasks (app priority 1, window priority 2)
# Calendar (app priority 1, window priority 3)
# Карта отдельно (app priority 1, window priority 2)
 
=== Left bottom A window (LBAW) ===
Обычно используется долговременно.
 
# Камера заднего вида (RHD) (app priority 1, window priority 1)
# Карта и навигатор вместе (app priority 2, window priority 2)
 
=== Left bottom B window (LBBW) ===
Обычно используется долговременно.
 
# Навигационная сетка отдельно или вместе IFF (включается только с навигационной сеткой), если включена функция IFF (app priority 1, window priority 1)
# Radio Detection modes (RD-RDF, RD-DD, RD-EOD, RD-RWR) отдельно или вместе с навигационной сеткой, плюс IFF (app priority 1, window priority 2)
# Passive radar (view mode) отдельно или вместе с навигационной сеткой, плюс IFF, RD-RDF, RD-DD, RD-RWR (app priority 1, window priority 3)
# Computer Hearing (DHUM, DAM) отдельно или вместе с навигационной сеткой, плюс IFF (app priority 1, window priority 4)
 
=== Central left window (CLW) ===
Обычно используется долговременно.
 
# Фронтальная камера (в зависимости от выбранных функций: FHD, SWIR, LWIR, SLV, MXV Type 1-4)
# Fire assist (наложение на вид фронтальной камеры)
# Внешняя камера (цифровой прицел, камера дрона или робота, камера другого пользователя)
# Drone remote control (камера дрона и виртуальные органы управления: 2 джойстика и 2 группы кнопок)
# Fire turret remote control
 
=== Central right window (CRW) ===
Обычно используется долговременно.
 
То же самое, что CLS. Окна могут быть включены по-отдельности, оба одновременно или объединённый вид. На один вид может быть наложены отображения нескольких функций, например:
 
* Mixed Vision Mode (MXV Type 1: FHD + SWIR) + Fire assist
* Mixed Vision Mode (MXV Type 2: SWIR + LWIR) + Fire assist
* Mixed Vision Mode (MXV Type 3: FHD + SWIR + LWIR) + Fire assist
* Mixed Vision Mode (MXV Type 4: FHD + SWIR + CLV (LWIR silhouette mode)) + Fire assist
* FHD + Computer Vision mode (OD, MD, FD) + Radio Detection mode (Radio Direction Finding - RDF)
* FHD + Computer Vision mode (OCR, FD, FR)
* MXV3 + Computer Vision mode (OD, MD) + Fire assist
* MXV1 + Radio Detection mode (Drone Detection - DD) + Fire assist
* Drone view + Computer Vision mode (OD, MD, HSTD)
 
=== Right System window (RSW) ===
Обычно используется долговременно.
 
# System and apps messages (приоритет 1)
# User tips (приоритет 1)
 
=== Right top A window (RTAW) ===
Обычно используется кратковременно, чтобы не ограничивать видимость окружающей среды.
 
# System or apps settings (app priority 1, window priority 1)
# Networks settings (app priority 1, window priority 2)
# Devices settings (app priority 1, window priority 3)
# Workgroups
# SDR 2-way settings
# Cryptologic control
 
=== Right top B window (RTBW) ===
Используется при необходимости, не рекомендуется во время интенсивного боя, чтобы не ограничивать видимость окружающей среды.
 
# SDR Scan modes (app priority 1, window priority 1)
# Wiki (app priority 1, window priority 2)
# File explorer (app priority 1, window priority 3)
# Multimedia player (app priority 1, window priority 4)
# Translator (app priority 1, window priority 5)
# Virtual mentor (video chat) (app priority 1, window priority 6)
 
=== Right bottom A window (RBAW) ===
Обычно используется долговременно.
 
# Icon messaging system (IMS) (app priority 1, window priority 1)
# Passive radar control (app priority 1, window priority 2)
# Active phased array radar control (app priority 1, window priority 3)
 
=== Right bottom B window (RBBW) ===
Обычно используется долговременно.
 
# Multichannel chat (app priority 1, window priority 1)
# Icon messaging system (IMS) (app priority 1, window priority 2)
 
== Screen control ==
 
== Features description ==
Таблица приоритетов окон и приложений. Функция (пресет) - окна по приоритетам - Возможности для пользователя
 
=== Features presets ===
{| class="wikitable"
{| class="wikitable"
|+
|+
! style="width: 15%" | Features presets
! style="width: 8%" |Indication
! style="width: 55%" | Description
! style="width: 25%" |Designation
! style="width: 30%" | Priority and Notice
! style="width: 7%" |Field
! style="width: 60%" |Change of display / Short description
|-
|-
|[[File:Time@4x.png|left|56x56px|frameless]]
|Time / Date
|Time / Date
|1.
|
|
|
*''Selected / Not selected:'' not applicable
|-
|-
|[[File:Battery@4x.png|left|frameless|40x40px]]
|Battery
|Battery
|1.
|
|
|
*''Not selected:'' Battery Saver (BSVE) disabled - displays levels 40-60-80-100% - azure color
*''Selected:'' BSVE enabled - <40% - yellow color, <10% - red color
|-
|-
|[[File:Water@4x.png|left|frameless|40x40px]]
|Water
|Water
|1.
|
|
|
*''Not selected:'' Water Saver (WSVE) disabled - displays levels (12 bars) >5/12 - azure color
*''Selected:'' WSVE enabled - <5/12 - yellow color, <2/12 - red color
|-
|-
|Spotlight modes
|[[File:Spotlight@4x.png|left|frameless|40x40px]]
|Режимы
|Spotlight
Управляется через программный интерфейс (меню статусов) и аппаратными кнопками на амбюшоре левого наушника (? какие кнопки за что отвечают).
|1.
|
|
*''Not selected:'' disabled - displays the intensity level of the last use (5 divs: 20-40-60-80-100%) - azure color
*''Selected:'' enabled - displays the current intensity level - yellow color
**in flickering mode - displayed with flickering
**in strobe mode - red
|-
|-
|[[File:Brightness mode@4x.png|left|frameless|20x20px]]
|Brightness modes
|Brightness modes
|
|2.
|
|States are the default. Selecting a mode changes the brightness and fading of the fields (fading pads and all windows at the same time, it acts as sunglasses). For some apps, the app window fading settings are adjusted individually in the app for greater contrast, these settings take priority over the default settings
|-
|[[File:Windows modes@4x.png|left|frameless|26x26px]]
|Windows modes
|3.
|States are the default. The user can quickly and flexibly manage the window configuration for each window individually, see below '''Windows items description'''
|-
|-
|Cameras modes
|[[File:Camera modes@4x.png|left|frameless|26x26px]]
|
|Camera modes
|
|4.
|States are the default. Depending on weather conditions and time of day, indoor or outdoor user activity, a quick preset selection is needed for effective surveillance, detection, and task execution
|-
|-
|[[File:Audio modes@4x.png|left|frameless|26x26px]]
|Audio modes
|Audio modes
|
|5.
|
|States are the default. Allows the user to quickly turn the loudspeaker on or off (as well as the buttons on the left headphones ear cup). Adjust the loudspeaker volume and monitor its status
Also allows to quickly adjust the mode and volume of the headphones (as well as the buttons on the right headphones ear cup). At least one mode and one headphone volume level are always on
|-
|-
|[[File:Computer Vision modes@4x.png|left|frameless|26x26px]]
|Computer Vision modes
|Computer Vision modes
|
|6.
|
|States are the default. Presets are available to the user for quick selection depending on tactical tasks. Presets can be turned on several at the same time and separately, which makes it possible to optimize the used computing resources and power consumption
|-
|Computer Hearing modes
|
|
|-
|-
|Radio detection modes
|[[File:Computer Hearing modes@4x.png|left|frameless|26x26px]]
|
|Computer Audition modes
|
|7.
|States are the default. A person hears sound as several frequencies (frequency carriers) at the same time and different frequencies at different volume levels. Presets are available to the user for quick selection depending on tactical tasks. Presets can be turned on several at the same time and separately, which makes it possible to optimize the used computing resources and power consumption
|-
|-
|RFDD
|[[File:Radio Detection modes@4x.png|left|frameless|20x20px]]
|
|Radio Detection modes
|AARTOS<ref name=":0" />
|8.
|States are the default. Any mission is associated with the tasks of SIGINT, identification of friend or foe, detection of drones and robots, anti-personnel and anti-tank mines, trip wires, IEDs, and counter-radar protection for each military person without exception. Presets are available to the user for quick selection depending on tactical tasks. Presets can be turned on several at the same time
|-
|-
|Firing assistance modes
|[[File:Firing Assistance modes@4x.png|left|frameless|20x20px]]
|
|Firing Assistance modes
|
|9.
|States are the default. This mode helps to conduct accurately aimed fire using all types of sights: Red Dot, telescopic sight, and digital sight and is also compatible integration with the remote control of the robotic turret
|-
|-
|[[File:Stealth modes@4x.png|left|frameless|27x27px]]
|Stealth modes
|Stealth modes
|
|10.
|
|States are the default. This mode is necessary to limit visibility by means of enemy SIGINT
|-
|-
|Vitals body tracking modes
|[[File:Vitals Body tracking modes@4x.png|left|frameless|26x26px]]
|
|Vitals Body Tracking modes
|
|11.
|Vitals Body Sensors Control (VBS)
|-
|-
|[[File:Networks modes@4x.png|left|frameless|34x34px]]
|Networks modes
|Networks modes
|
|12.
|
|Networks (NET)
|}
|}


=== Applications ===
==='''SB Presets'''===
{| class="wikitable"
{| class="wikitable"
|+
|+
! style="width: 15%" | Apps
! style="width: 8%" |Indication
! style="width: 55%" | Description
! style="width: 15%" |Field name
! style="width: 30%" | Priority and Notice
! style="width: 7%" |Preset
! style="width: 20%" |Preset name
! style="width: 50%" |Actions
|-
|-
|Instant messaging system (IMSG)
| rowspan="4" |[[File:Time@4x.png|left|56x56px|frameless]][[File:Battery@4x.png|left|frameless|40x40px]][[File:Water@4x.png|left|frameless|40x40px]][[File:Spotlight@4x.png|left|frameless|40x40px]]
|Instant messaging system распознаёт жесты и голосовые команды для отправки участникам группы или персонально иконографические символы, по примеру дорожных знаков. Чаще всего применяется в тактических задачах штурмовыми подразделениями, разведгруппами и снайперами.
| rowspan="4" |Time / Date, Battery, Water, Spotlights modes
|na
|Time / Date
|
|
*each click alternates the display of the current time and date, nothing else
|-
|-
|Multichannel chat (CHAT)
|na
|Приложение позволяет принимать и отправлять сообщения (в т.ч. с запросом ответа). Сообщения содержат текст, изображения (в т.ч. скриншот), видео, аудио, файл. Позволяет видеть доступных абонентов, непросмотренные сообщения, исходящие и входящие сообщения без ответа. Позволяет преобразовывать голос в текст и, наоборот, озвучивать текст. Позволяет настраивать каналы и приоритеты.
|Battery
|
|
* В правом верхнем углу отображается счётчик уведомлений о сообщениях, требующих ответа
*each click, the display of the indication of the battery and the water supply of the drinking system alternates
* В левом нижнем углу отображается число непросмотренных сообщений
*in the Selected state, launches the Battery Saver (BSVE) application, which allows to optimize power consumption
*at <40%, the BSVE application starts automatically, at <10%, only the minimum necessary functions and applications function
|-
|-
|eMail (MAIL)
|na
|Water
|
|
|
*each click, the display of the indication of the battery and the water supply of the drinking system alternates
 
*when in the Selected state, launches the Water Saver (WSVE) application, which allows to hydrate on a schedule (text and voice user notifications)
*at level <5/12, the WSVE application starts automatically, at <2/12 the hydration mode changes (interval increases, monitoring of vital signs indicators is turned on, a message is sent to the cloud system)
|-
|-
|Tasks (TSK)
|na
|Фильтры:
|Spotlight
* Overdue (OVDU)
* Ongoing (ONGO)
* Assisting (ASST)
* Set by me (SBME)
* Following (FLWG)
* Comments (CMNT)
* Done (DONE)
Система управления задачами позволяет планировать и контролировать срок, точность, результаты, эффективность выполнения задач. Содержит описание, чек-лист, дедлайн, фактическое время выполнения и затраченное время (в т.ч. автотрекинг завершения и отсчёт затраченного времени), уведомление о текущем статусе, геопозицию в момент завершения, артефакты подтверждения выполнения задачи, вложения, комментарии.
|
|
* В правом верхнем углу отображается счётчик уведомлений о просроченных задачах и с приближающимся дедлайном
*alternative to a long click - a long press of the button on the left headphones ear cup turns on, and when you click again, turns off the flashlight
* В левом нижнем углу отображается число задач на сегодня
*when click (or +/- button on the left headphones ear cup simultaneously with the flashlight control button) switches the light intensity (5 options)
*when simultaneously pressing the B button (on the left headphones ear cup) + the flashlight control button (on the left headphones ear cup) with one hand, it turns on the flickering mode (SOS)
*when simultaneously pressing with both hands the D button (on the right headphones ear cup) + the flashlight control button (on the left headphones ear cup) turns on the strobe mode
*after turning off, when turned on again, it turns on the constant light mode and the intensity of the last use
*when the full invisibility mode is on, the user will not be able to turn on the flashlight
*in battery saving mode, the intensity will be reduced automatically or automatic shutdown will occur
*fine adjustments are made in the LED Spotlight settings (SPOT) app
|-
|-
|Calendar (CAL)
| rowspan="7" |[[File:Brightness mode@4x.png|left|frameless|20x20px]]
|Фильтры:
| rowspan="7" |Brightness modes
* Day (DAY)
''OR condition when selecting presets (selecting one preset cancels the selection of the previously selected preset)''
* Week (WEEK)
|AUTO
* Month (MNTH)
|Auto
* Year (YEAR)
Календарь событий позволяет заранее планировать и согласовывать события, требующие определённого регламентов времени: коллективные онлайн и офлайн коммуникации, собрания, учебные семинары, командировки.
|
|
* В правом верхнем углу отображается счётчик уведомлений о просроченных событиях и с приближающимся сроком
*the light sensor detects the ambient light level and uses the settings of one of the following modes
* В левом нижнем углу отображается число событий на сегодня
*fading windows 100% in all ''full-color'' projections
|-
|-
|Workgroups (WGR)
|CLR
|
|Clear day
* Tactical (TAC)
|fading pads 50%, fading windows 50%, projector beam 100%
* ISR
* Fire support (FSUP)
* Fast air (FAIR)
* Medical assist (MAS)
* Evacuation (EVAC)
* Logistic (LOG)Субменю содержит фильтры для групп.
 
Можно выбрать участника или группу в соответствующем разделе для коммуникаций, обмена данными, отправки или запроса позиции. Элемент CDI (Cross-Domain Interaction).
|
* В правом верхнем углу отображается количество доступных участников групп
 
* В левом нижнем углу отображается число активных рабочих групп, в которых состоит пользователь
|-
|-
|Drone control (FPVC)
|CLD
|Drone control - First Personal View Control (FPVC) - приложение для управления RPA, UAV в соответствии с протоколом связи и функциями, предоставленными производителем для интеграторов. Включает ручное управление через радиосигнал, автоматические команды данной модели, модель управления с помощью ИИ. Основные команды: Arm, Disarm, Take, Land, Return, Start mission, Stop mission, Stop, Follow me, Follow target, Circle around me, Circle around target.
|Cloudy
Интеграция настраивается в разделе меню Devices.
|fading pads 25%, fading windows 25%, projector beam 75%
|Open source
[https://www.fpv24.com/de/tbs-tango-fpv-rc-funkfernsteuerung FPV R/C]
|-
|-
|Robot control (RBRC)
|TWL
|
|Twilight
|
|fading pads 0%, fading windows 0%, projector beam 75%
|-
|-
|Fire turret remote control (FTRC)
|DRK
|
|Dark night
|
|fading pads 0%, fading windows 0%, projector beam 50%
|-
|-
|Unmanned vehicle remote control (UVRC)
|NLTS
|
|Night lights
|
|fading pads 50%, fading windows 25%, projector beam 75%
|-
|-
|Passive covert surveillance radar (PCSR)
|DZLD
|Passive covert surveillance radar (PCSR) - приложение для внешнего устройства, которое устанавливается на устройство сверху в NMG mount и подключается в разъём USB. Приложение для типа пассивного (бистатического или мультистатического) радара, не имеющего собственного излучения, который обнаруживает и сопровождает объекты, обрабатывая отражения от не взаимодействующих источников освещения в окружающей среде, таких как сигналы коммерческого вещания и связи, а также эхо сигналов других радаров, положение которых известно. Они позволяют рассчитать местоположение, направление и скорость объекта. В некоторых случаях можно использовать несколько передатчиков и/или приемников для выполнения нескольких независимых измерений бистатической дальности, доплеровского сдвига и пеленга и, следовательно, значительно повысить точность окончательного пути.
|Dazzling day
|
|fading pads 75%, fading windows 75%, projector beam 100%
|-
|-
|Active phased array radar remote control (APAR)
| rowspan="7" |[[File:Windows modes@4x.png|left|frameless|26x26px]]
|Active phased array radar remote control (APAR) - приложение для удалённого управления малозаметным мобильным активным (излучающим) радаром с активной фазированной решёткой и обмена с ним данными. AESA transmit-receive module - TRM (remote control) small tactical radar. Твердотельные приёмо-передаточные модули радара направлены в разные направления без перемещения антенны. См. Northrop Grumman AN/ZPY-1 STARLite Small Tactical Radar - Lightweight.
| rowspan="7" |Windows modes
|
''AND / OR condition when selecting presets (selecting one preset in one case cancels, and in the other case does not cancel the selection of the previously selected preset)''
|DFLT
|Default
|displays all active windows according to the configured application and feature priorities; DFLT - deselects any previously selected preset
|-
|-
|Metal re-radiation radar (METR)
|OFF
|Metal re-radiation radar (METR)
|Turn off all windows
|
|turns off the display of all windows; OFF - deselects any previously selected preset
|-
|-
|SDR Scan (SDRS)
|CLW
|SDR Scan - приложение для сканирования, декодирования, анализа, прослушивания (аналоговых и незашифрованных сигналов), ретрансляции радиочастот в диапазоне 1 MHz - 6 GHz, включая диапазоны ТВ и радиовещания, радиолюбительские диапазоны, РЛС, авианавигации, радиомаяки, частоты мобильной связи, беспроводных сетей.
|Central left window is On, central right window is Off
|Open source
|if both central windows (left and right) were used by default, disables the central right window, all functions remain available in the central left window; CLW cancels CRW and vice versa
|-
|-
|SDR 2-way (SDR2)
|CRW
|SDR 2-way - приложение для управления коммуникациями в разных частотных диапазонах: HF (2-30 MHz), VHF low (30-66 MHz), VHF high (136-174 MHz), UHF (230-400, 400-470, 790-870, 1200-1260 MHz, incl. HAM, LPD, PMR 446, ISM). (!) Сверить частоты по спецификациям!!
|Central right window is On, central left window is Off
|Open source
|as in the previous case, on the contrary, disables the central left window, improving the view of the environment; CRW cancels CLW and vice versa
|-
|-
|Cryptologic control (CRPT)
|BWON
|Cryptologic control - приложение для управление ключами и шифрованием.
|Bottom windows only
|
|turns off the upper windows (except LUW and RUW) on the left and right to improve the view ("knight's narrow visor effect"), transfers higher priority windows to the lower area, closes lower priority windows, does not turn off the central windows; BWON cancels LWON and RWON
|-
|-
|Multimedia player and recorder (MMPR)
|LWON
|Multimedia recorder and player - приложение для записи видео (в т.ч. экранного), аудио (в т.ч. с внешних микрофонов и из приложений), фото и для просмотра файлов мультимедиа, в т.ч. быстрый поиск фото. Записывает теги и примечания для каталогизации и поиска.
|Left windows only
|Open source
|turns off all windows on the right (except RUW) ("left eye effect"), transfers higher priority windows to the left area, closes lower priority windows, does not turn off central windows; LWON cancels RWON and BWON
|-
|-
|Translator (TRSL)
|RWON
|Приложение для перевода текстов на основе ИИ.
|Right windows only
|Open source
|turns off all windows on the left (except LUW) ("right eye effect"), transfers higher priority windows to the right area, closes lower priority windows, does not turn off central windows; RWON cancels LWON and BWON
|-
|-
|Virtual mentor (VM)
| rowspan="9" |[[File:Camera modes@4x.png|left|frameless|26x26px]]
|Приложение видеоконференции с двумя и более лицами, включая разные сети.
| rowspan="9" |Cameras modes
|Open source
''AND / OR condition when selecting presets (selecting one preset in one case cancels, and in the other case does not cancel the selection of the previously selected preset)''
|FHD
|Frontal HD cam
|uses visible light range (400-780 nm) and dual sensor capabilities, high resolution and wide dynamic range under strong contrast lighting
|-
|-
|Maps (MAP)
|RHD
|
|Rear HD cam
* Navigation
|turn the rear view camera on and off
* Path tracking
* Mission planning
|ATAK MIL SDK
|-
|-
|Wiki (WIKI)
|SWIR
|
|Night / Sky / Fog / Sea vision mode
* Manuals
|uses a wider short-wavelength infrared light range (780-1700 nm), which is used to observe the reflection of ambient light in this range by objects located on the surface of the water, in fog, in smoke, in clouds, at dusk and at night
* Reports
* Articles
* Updates
* Tutorial
|Open source
|-
|-
|File explorer (FILE)
|LWIR
|Приложение для просмотра, организации в папках, копирования, перемещения и открывания файлов.
|Thermal image vision mode
|Open source
|uses long-wavelength invisible infrared light (7.5-14 µm) emitted by objects warmer in relation to the environment, mainly at night
|}
 
=== Services ===
{| class="wikitable"
|+
! style="width: 15%" | Services
! style="width: 55%" | Description
! style="width: 30%" | Priority and Notice
|-
|-
|Networks (NET)
|SLV
|
|Silhouette vision mode
* VHF / UHF
|turns on the transformation of the fill into a color outline mode that is well distinguishable in relation to the background for contrasting objects
* HF
* LTE
* 5G
* WLAN
* Bluetooth
* P2P
|
|-
|-
|IFF
|MXV1
|
|Mixed vision mode Type 1: FHD + SWIR
|
|allows to use the capabilities of three different sensors in different conditions day and night; 4K UHD + HDR + SWIR
|-
|-
|Voice assistant
|MXV2
|
|MXV Type 2: SWIR + LWIR
|Open source
|allows to use the capabilities of two different sensors in different conditions day and night; SWIR + LWIR
|-
|-
|Speech-to-text
|MXV3
|
|MXV Type 3: FHD + SWIR + LWIR
|Open source
|allows to use the capabilities of four different sensors in different conditions day and night; 4K UHD + HDR + SWIR + LWIR
|-
|-
|Voiceover
|MXV4
|
|MXV Type 4: FHD + SWIR + LWIR (silhouette mode)
|Open source
|allows to use the capabilities of four different sensors in different conditions day and night; 4K UHD + HDR + SWIR + LWIR (silhouette mode)
|-
|-
|Fading pads and screens
| rowspan="8" |[[File:Audio modes@4x.png|left|frameless|26x26px]]
|
| rowspan="8" |Audio modes
''AND / OR condition when selecting presets (selecting one preset in one case cancels, and in the other case does not cancel the selection of the previously selected preset)''
|LSPK
|Loudspeaker On/Off
|
|
*alternative to a long click - a long press of the Loudspeaker control button on the left headphones ear cup turns on, and when you long click again, turns off the loudspeaker
*the volume is changed with one hand with the +/- buttons on the left headphones ear cup at the same time as the loudspeaker power button (when it is turned on)
*after turning off when turning on again sets the volume of the last use
*in full stealth mode, the user will not be able to turn on the loudspeaker
|-
|-
|Hand tracking system
|L
|Left On, right Off
|
|
|Open source
*alternative to a long click - a long press of the Headphones control button on the right headphones ear cup ''switches only'' between L, R, LR modes; L cancels R, LR
*the soundproof flap in the left headphones ear cup is ''closed''
*the volume is changed by selecting presets 25, 50, 75, 100 or using the +/- buttons on the right headphones ear cup
*after switching when selected again sets the volume of the last use
|-
|-
|Joystick and buttons calibration
|R
|Right On, left Off
|
|
|Open source
*see above; R overrides L, LR
*the soundproof flap in the right headphones ear cup is ''closed''
|-
|-
|Camera control
|LR
|Zoom, filters, modes, mixed, calibration
|Left On, right On
|Open source
|-
|Stereo camera control
|Triangulation, distance measurement
|
|
*see above; LR cancels L, R
*the soundproof flaps in both headphones ear cups are ''open''
|-
|-
|Accelerometer (m/s^2)
|25
|Line and angle acceleration
|25% sound level
|
|changes the headphone volume; 25 cancels 50, 75, 100
|-
|-
|Gyroscope (rad/s)
|50
|Incline, position, sightline, horizon
|50% sound level
|
|changes the headphone volume; 50 cancels 25, 75, 100
|-
|-
|GNSS
|75
|GPS, Galileo, QZSS
|75% sound level
|
|changes the headphone volume; 75 cancels 25, 50, 100
|-
|-
|Hall sensor (magnetometr) (µT)
|100
|Compass
|100% sound level
|
|changes the headphone volume; 100 cancels 25, 50, 75
|-
|-
|Barometr (hPa)
| rowspan="6" |[[File:Computer Vision modes@4x.png|left|frameless|26x26px]]
|Pressure
| rowspan="6" |Computer Vision<ref name=":1">Wikipedia, [[wikipedia:Outline_of_computer_vision|"Outline Computer Vision"]]</ref><ref name=":2">Wikipedia, [[wikipedia:Computer_vision|"Computer Vision"]]</ref> modes
''AND condition when selecting presets (selecting one preset in one case does not cancel the selection of a previously selected preset)''
|OD
|Object detection
|
|
*OD based on a trained neural network allows to detect people, equipment, drones, artificial structures from different angles and at different distances, highlighting them on the screen, measuring distance, azimuth, elevation, height above the ground, speed, course destination and geolocation, as well as displaying them on the navigation grid
*launches the CVC app in the CRW window by default at the same time as the last used front camera preset (FHD, SWIR, LWIR, SLV, MXV1-4)
*if necessary, prompts the user to select another front camera preset, as well as launch Computer Audition and Radio Detection presets to refine detection results
*uses local pattern library only
*can be run simultaneously with MD, FD, FR, OCR, HSTD presets
|-
|-
|Thermometer (°C)
|MD
|
|Motion detection
|
|
*MD helps to detect moving objects, people and evehicles ignoring the flights of birds and insects, tand he movement of clouds. MD mode is recommended to be used in conjunction with Radio Frequency Drone Detection (RFDD) and Computer Audition Detect noises of aircraft motor (DAM) preset
*uses local pattern library only
*can be run simultaneously with OD, FD, FR, OCR, HSTD presets
|-
|-
|Ambient light sensor (lux)
|FD
|
|Facial detection
|
|
*FD incl. using LWIR camera sensor and trained neural network helps to detect people's faces
*uses local pattern library only
*can be run simultaneously with OD, MD, FR, OCR, HSTD presets
|-
|-
|Humidity sensor (%)
|FR
|
|Facial recognition
|
|
*FR using a neural network in the presence of an exchange with the server allows to recognize people's faces for identification (part of the database can be stored on a local drive)
*always executed at the same time as the FD preset
*can be run simultaneously with OD, MD, OCR, HSTD presets
|-
|-
|Gas sensor (CO, NO2)
|OCR
|
|Optical character recognition
|
|
*OCR allows to recognize text and other graphic characters for subsequent translation and documentation
*uses local pattern library only
*can be run simultaneously with presets OD, MD, FD, HSTD
|-
|-
|Radiation sensor
|HSTD
|
|Heat and smoke trace detection
|
|
|}
*HSTD helps detect aircraft and missile trajectories, artillery and mortar fire from closed masked positions
 
*uses local pattern library only
=== Embedded devices ===
*can be run simultaneously with presets OD, MD, FD, FR
{| class="wikitable"
|+
! style="width: 15%" | Services
! style="width: 55%" | Description
! style="width: 30%" | Priority and Notice
|-
|-
|Multimedia
| rowspan="6" |[[File:Computer Hearing modes@4x.png|left|frameless|26x26px]]
|
| rowspan="6" |Computer Audition modes
* Headphones
''AND condition when selecting presets (selecting one preset in one case does not cancel the selection of a previously selected preset)''
* Microphones (3)
|DAM
* Loudspeaker
|Detect noises of aircraft motor
|
|
*DAM, unlike DHUM, works only with patterns of aerodynamic, electromechanical and mechanical noise, using a trained neural network, isolating and amplifying sounds and noises that are most likely associated with the operation of drones, helicopters, turboprops and jet aircraft
*this preset allows to focus on likely threats from the air and determine the direction of the source of sound waves
*DAM is recommended to be used in conjunction with Radio Frequency Drone Detection (RFDD) and Computer Vision Motion Detect (MD)
*uses local pattern library only
*can be played simultaneously with ENAT, ECHO, DHUM, STHR presets
|-
|-
|Cameras
|ENAT
|
|Exclude sounds of nature
* HD cameras
* SWIR camera
* LWIR camera
|
|
*ENAT sequentially selects the sounds and noises of nature (wind, rustle of leaves, birdsong, water sound, etc.) in several frequency ranges with the help of filters, then using a trained neural network to select patterns for final filtering
*this preset allows to focus on the sounds and noises associated with human activity
*uses local pattern library only
*can be played simultaneously with presets DAM, ECHO, DHUM, STHR
|-
|-
|Transponder
|ECHO
|
|Eliminate echo
|
|
*ECHO, using built-in algorithms, allows to detect primary and reflected sound waves in order to correct the direction of the source of sound waves when other presets are working
*prompts the user when to enable this preset if one of the other presets is already enabled
*uses local pattern library only
*can be played simultaneously with DAM, ENAT, DHUM, STHR presets
|-
|-
|SDR IC
|DHUM
|
|Detect noises of human activity
|
|
*unlike ENAT, DHUM works in the opposite direction, using a trained neural network, to isolate and amplify sounds and noises that are most likely associated with human activity (tire friction, footstep sounds, stone friction, radio speaker sound, engine sounds, electromechanical noise, coughing, sneezing, speech, etc.)
*this preset highlights these patterns of audio frequencies, amplifies them, while attenuating the sound level of the environment
*this preset allows to focus on the sounds and noises associated with human activities, and determine the direction of the source of sound waves
*this preset also uses the method of acoustic location and determining the coordinates of the enemy battery based on the sound of firing its guns (or mortars, or rockets)<ref>Wikipedia, [[wikipedia:Artillery_sound_ranging|Artillery sound ranging]]</ref>
*uses local pattern library only
*can be played simultaneously with DAM, ENAT, ECHO, STHR presets
|-
|-
|STHR
|Limit sound threshold
|
|
|
*STHR assists the user in variable high ambient sound pressure conditions by dynamically reducing the maximum level by ∆ 80 dB SPL to 15-85 dB SPL
|
*STHR is synchronized with the electromechanical sound dampers in the headphone design
*can be played simultaneously with DAM, ENAT, ECHO, DHUM preset
|-
|-
|
|GFL
|
|[[Gunfire locator|Gunfire Locator]]
|
|is a system that detects and conveys the location of gunfire or other weapon fire using acoustic[2], vibration, optical[3], or potentially other types of sensors, as well as a combination of such sensors. These systems are used by law enforcement, security, military, government offices, schools and businesses to identify the source and, in some cases, the direction of gunfire and/or the type of weapon fired.
|-
|-
| rowspan="5" |[[File:Radio Detection modes@4x.png|left|frameless|20x20px]]
| rowspan="5" |Radio detection modes
''AND condition when selecting presets (selecting one preset in one case does not cancel the selection of a previously selected preset)''
|IFF
|Identification Friend-or-Foe
|
|
|
*IFF uses a transponder (transmitter-responder) Identification Friend-or-foe system, which in response to an encrypted interrogation signal received on one frequency, sends an encrypted message packet on another frequency containing the confirmation "Friend", Id, callsign and position
|
*when used simultaneously with one of the "Stealth" modes presets, IFF will send a response message at different frequencies, in different networks, and with different power (for a limited distance) or will not send a message at all
*a transponder with a specified interval at certain frequencies periodically generates and sends interrogation signals to an indefinite circle of people for registration and display on the navigation grid of one of the screens of user positions, with confirmation "Friend"
*interrogation signals sent via an omnidirectional antenna or a directional antenna (the omnidirectional pattern can be limited by a reflective array or a software-defined antenna can be used)
|-
|-
|RDF
|Radio Direction Finding<ref name=":3">Wikipedia, [[wikipedia:Direction_finding|"Radio direction finding"]]</ref>
|
|
|
*RDF applies the radio direction finding of received radio frequencies that are identified as potentially threatening (radar, EW&SIGINT, ECM systems) or identified as the source of an RF carrier (analog or digital signal) for communication
|
*using triangulation in collaboration with a similar device of another user in the P2P network (at a short distance with it) determines the direction and distance to the radio signal source
*without the help of another user's device or software-defined antenna determines only the direction (course) to the radio signal source
*commonly used after running the SDR Scan (SDRS) app to first identify the characteristics of the radio signal and not unmask itself unnecessarily
*in accordance with the current rules and restrictions, the mission can initiate a task for the above IFF app if the interrogation signal is not sent to identify the source of the signal by other methods or with the help of other persons
*in conditions of distortion or jamming of radio signals of navigation satellite systems, it is used for radio navigation using terrestrial radio beacons operating in other frequency bands, including FM, TV and mobile radio broadcasting bands
|-
|-
|RFDD
|Radio Frequency Drone Detection<ref name=":0">AARTOS, [https://drone-detection-system.com/sensor-types-overview/detection-rf/#:~:text=AARTOS%E2%84%A2%20RF%20Detection.,by%20comparing%20different%20frequency%20patterns. "RF Drone Detection"], [https://drone-detection-system.com/sensor-types-overview/detection-rf/#antennas "Antennas"]</ref>
|
|
|
*RFDD enables the mode of radio frequency detector used to detect the presence of RF waves in physical transmission mediums
|
*the system uses these RF Detectors to detect drones and drone pilots (land, waterborne and aerial drones)
*RFDD also uses AI to identify the type of threat by comparing different frequency patterns
*the system can easily distinguish drones from common RF signals by using learned patterns and can identify almost all types of threats as well as the location of the drone pilot
*can use a compact omnidirectional mobile manpack antenna, a directional software-defined antenna, or a longer-range mobile portable antenna
*has a range of 9 kHz - 8 GHz and a detection distance of up to 3 miles (conical or dome range)
*this function displays on the navigation grid and / or on the map of the terrain of the interface screens the positions of the identified RPA (UAV) and its operator
*RFDD mode - a special case of the RDF function, it is recommended to use it in conjunction with the Computer Vision Motion detection (MD) and Computer Audition Detect noises of aircraft motor (DAM) modes
|-
|-
|EODD
|Radio Frequency Explosive Ordnance Disposal Detection
|
|
|
*EODD - uses an external handheld Metall Re-radiation Radar (MET3R) device, via a Bluetooth or Wi-Fi Direct connection
|
|-
|-
|RWR
|Radar Warning Receiver<ref name=":4">Wikipedia, [[wikipedia:List_of_radar_types|"List of radar types"]], [[wikipedia:Counter-battery_radar|"Counter-battery radar"]]</ref>
|
|
|
*RWR - turns on the mode of detecting exposure from air defense radars and counter-battery radar<ref name=":5">Wikipedia, [[wikipedia:Counter-battery_radar|"Counter-battery radar"]]</ref>, displays on the screen in a window with a navigation grid and/or a map the geolocation of these radars
|
*RWR mode is indispensable when performing tactical tasks of mortar and artillery fire
|-
|-
| rowspan="5" |[[File:Firing Assistance modes@4x.png|left|frameless|20x20px]]
| rowspan="5" |Firing assistance modes
''OR condition when selecting presets (selecting one preset cancels the selection of the previously selected preset)''
|GF
|Fire on ground fixed targets
|
|
|
*captures and tracks up to 10 targets simultaneously
|
*for each target calculates the ballistic trajectory at a distance based on 20 parameters
*displays 16 ballistic calculation reference data (display can be turned off)
*the user sees in the interface and can make manual changes (input field) to the parameters of the ballistic calculation
*displays the aiming point taking into account corrections on the reticle relative to the crosshair with a scale in the form of digital data (Eunit and Wunit) MOA/MIL (true minute of angle/milliradian)
*separately displays the numerical values ​​of the corrections: Elevation and Windage when using Red Dot Sights or Holographic Sights (both eyes open), the user visually compares the position of the aiming dot and corrections relative to the crosshair on the screen (point of impact) and the contour of the target - with the contour in the sight window and the sight dot (usually 2-5 MOA), such shifting the sight dot (line of sight) in a way to hit the target at the crosshair point as on the screen of the device
*when integrated with a digital sight, it immediately displays on the screen in the form of a diamond the sighting line of the digital sight, which must be aligned with the displayed aiming point
*evaluates the inaccuracies of the ballistic calculation in case of a miss and offers the user corrections (takes into account aiming inaccuracies only for a digital sight)
|-
|-
|GM
|Fire on ground moving targets
|
|
|
*additionally calculates the angular velocity for the uniform movement of the target, the measurement of the distance to the target, the course of the target and indicates corrective lead corrections
|
|-
|-
|AM
|Fire on aerial moving targets
|
|
|
*additionally calculates the angular velocity, change in azimuth and elevation, determines the nearest probable trajectory with the designation of corrective lead corrections
|
|}
=== Integrated devices ===
{| class="wikitable"
|+
! style="width: 15%" | Services
! style="width: 55%" | Description
! style="width: 30%" | Priority and Notice
|-
|-
|Handheld radio
|MF
|
|Mountain fire on fixed targets (prospective function)
|
|
*additionally takes into account more complex parameters for calculating a ballistic trajectory in mountainous and desert areas based on an assessment of the landscape, temperatures, an assessment of ascending air currents and the mirage effect, shot history
|-
|-
|Telescopic sights
|MM
|External cameras
|Mountain fire on moving targets (prospective function)
|
|
*as above plus additionally calculates angular velocity and denotes lead corrections
|-
|-
|Drones
| rowspan="4" |[[File:Stealth modes@4x.png|left|frameless|27x27px]]
|
| rowspan="4" |Stealth modes
''OR condition when selecting presets (selecting one preset cancels the selection of the previously selected preset)''
|IFF
|IFF visible only
|
|
*all radio transmissions (including outgoing IFF interrogation signals) are blocked, with the exception of encrypted response messages of the Identification Friend-or-foe system transponder, including masking the transmission of a response message in the background noise frequency range of the broadcasting band (FM, TV) and using more long pauses in response intervals to interrogation signals (other radio strategies are possible to remain unnoticed)
*this mode enables the IFF mode of the same name in the Radio Detection modes section, if it has not been enabled
|-
|-
|Robots
|SD
|
|Short distance visible only
|
|
*only short range networks such as Bluetooth, Wi-Fi Direct (P2P) and UHF are used with limited transmission power over short distances
|-
|-
|Fire turrets
|FULL
|
|Zero emission
|
|
*all radio transmissions are blocked, only reception (completely passive mode), IFF mode is automatically turned off (and vice versa, when changing Stealth mode to another, IFF mode is turned on again)
*in full stealth mode, the user will not be able to turn on the flashlight and loudspeaker
|-
|-
|Antennas
|OFF
|
|OFF
|
|
*does not restrict radio transmission
|-
|-
|Radars
| rowspan="4" |[[File:Vitals Body tracking modes@4x.png|left|frameless|26x26px]]
|
| rowspan="4" |Vitals body tracking modes
* AESA
''OR condition when selecting presets (selecting one preset cancels the selection of the previously selected preset)''
* METR
|WRK
|Workout mode
|
|
*Vitals body data-driven monitoring including: HR bpm (ECG)<ref>Wikipedia, [[wikipedia:Monitoring_(medicine)|"Monitoring (medicine)"]]</ref> - assessment of rhythm and heart rate; NIBP mmHg (ART) - blood pressure; TEMP - body temperature; StO₂ % - non-invasive method for monitoring the level of oxygen saturation (saturation); ETCO₂ % - (capnometry) to measure the level of carboxyhemoglobin (COHb) and methemoglobin (MetHb); RESP bpm (RR) - Respiratory Rate; HYDRL - determines the amount and frequency of hydration
*displays tips for the user in case of many unwanted risks: bradycardia, tachycardia, arrhythmia, hypothermia, hyperthermia, hypoxemia, hyperventilation, hemorrhagic shock, etc.
*when a dangerous level of indicators occurs, displays a message to the user and sends an SOS message to the analytical center
*keeps a log of monitoring states
|-
|-
|TRN
|Training mode
|
|
|
*additionally takes into account the duration of the session of training exercises and the possibility of live fire training
|
*applies a programmatically set training mode for the use of automatic tourniquets
|-
|-
|TACT
|Tactical mode
|
|
|
*in addition to the above, if a dangerous level of acute massive blood loss occurs in one of the 8 sites protected by automatic tourniquets, it controls the "Care Under Fire" task for stop of acute bleeding and start emergency automatic fluid resuscitation
|
*if there is a risk of ventricular fibrillation, it automatically starts the defibrillation procedure under ECG control (cardio resuscitation)
*if necessary, start automatic pulmonary resuscitation using pneumatic pumps built into the design of air filters
|-
|-
|OFF
|OFF
|
|
|
*does not monitor
|
|-
|-
| rowspan="5" |[[File:Networks modes@4x.png|left|frameless|34x34px]]
| rowspan="5" |Networks modes /
Com status
AND
|Signal levels
|Network 1, 2, 3, 4
|
|
|
*displays a scale with the bandwidth level of each connected network
|
*displays the status of receiving and transmitting packets
*displays the packet transmission prohibition
*long click launches NET application
Signal levels, upload / download transmission status
|-
|-
|
|online
|
|
|
|
|-
|-
|
|back soon
|
|
|
|
|-
|-
|
|don't disturb
|
|
|
|
|-
|-
|
|offline
|
|
|
|
|}
|}


===Left main menu (LMM) and Right submenu (RSB)===
{{further|1=[[Public:Applications]],|2=[[Public:Voice User Interface]]|3=|4=|5=|6=|7=|8=|9=|10=}}


Нарисовать навигационную сетку в нескольких вариантах:
[[File:Pads-100-3.jpg|frameless|950x950px]]
 
* в левом нижнем Б окне
* в левом нижнем Б окне с прозрачным фоном
* на всю левую часть
* на всю левую часть с прозрачным фоном


== Features relations ==
# Face recognition включает LWIR
# Камеры (в т.ч. Drone View, User View) включают Computer Vision
== Fading pads ==
== Resources ==
=== Estimating computing power ===
{| class="wikitable"
{| class="wikitable"
|+
! colspan="2" |Left
! style="width: 15%" | Task performance
! colspan="2" |Center
! style="width: 25%" | Требования к CPU
! colspan="2" |Right
! style="width: 25%" | Требования к GPU
! style="width: 25%" | Требования к RAM и VRAM
! style="width: 15%" | Notice
|-
|-
|High-performance computing (HPC): ОС, основные приложения, камеры, мультимедиа, проектор
|LMMP
|
|Left main menu fading pads
|
|SBP
|
|Status bar fading pads
|intel.com/hpc
|RSBP
|Right submenu fading pads
|-
|-
|High-res Computer Vision, обработка потокового видео, фильтры
|LQMP
|
|Left quick menu fading pads
|
|CLW
|
|Central left window
|
|RQMP
|Right quick menu fading pads
|-
|-
|Computer Hearing, обработка звука, фильтры
|LFSP
|
|Left features sidebar fading pads
|
|CRW
|
|Central right window
|
|RFSP
|Right features sidebar fading pads
|-
|-
|Natural language processing, Machine Learning, DL
|LUW
|
|Left Upper window
|
|CWJP
|
|Central window joystick pads
|incl. distributed computing via P2P, ai.intel.com
|RUW
|Right Upper window
|-
|-
|Total Memory Encryption, Crypto Acceleration,
|LTAW
Multi-party compute, Cloud confidentional coputing, Key management
|Left Top A window
|
|CWBP
|
|Central window buttons pads
|
|RTAW
|intel.com/sgx
|Right Top A window
intel.com/cloud
|-
|-
|SDR Scan / 2-way, 5G
|LTBW
|Left Top B window
|
|
|
|
|
|RTBW
|intel.com/networking
|Right Top B window
|-
|-
|Radio Detection
|LBAW
|
|Left Bottom A window
|
|
|
|
|
|RBAW
|Right Bottom A window
|-
|-
|Radar Control
|LBBW
|
|Left Bottom B window
|
|
|
|
|
|RBBW
|Right Bottom B window
|}
|}


=== CPUs Comparison ===
The main menu (LMM) is located at the top left of the visible area and contains a list of sections.
[[File:LMM-RSB sceme.png|center|frameless|950x950px]]
Only 7 elements for quick selection in one row. Use the navigation arrows on the right to select the next row. The main menu is only displayed on hover or on a voice call. When inactive, hides after 15 seconds. Each element is located in a separate field (fading pad). Only the fields that display the section are shown.
 
The right submenu (RSB) is at the top right and expands the second lower level of the main menu items. Only 7 elements in one row. The arrows on the left are used for navigation. The right submenu is displayed only when one of the main menu items on the left (LMM) is active or when the submenu item is directly called by voice. When inactive, hides simultaneously with the main menu after 15 seconds. Each element is located in a separate field (fading pad). Only the fields that display the section are shown.
 
When an app is opened using this menu, it is displayed on the screen. If the user closes the app, it does not stop its work, but continues to work in the background, at the same time, an element with the name of this application appears in the [[Public:Graphical User Interface#Left quick menu (LQM)|Left quick menu (LQM)]] or [[Public:Graphical User Interface#Right quick menu (RQM)|Right quick menu (RQM)]] menu field to quickly return to the screen. See the sections Left quick menu (LQM) and Right quick menu (RQM) below for how to completely terminate the application.
[[File:LMM v1.0.png|center|frameless|1035x1035px|LMM v1.0]]<br>
[[File:Widgets menu v1.0.png|center|frameless|1035x1035px|Widgets menu v1.0]]
 
 
<br>
The sub-elements of the main menu and sub-menu are controlled by clicking (joystick, gesture control) or by voice. States:
 
*''Hover state:'' 4 corner field frame segments
*''Click state:'' frame on the field border (animation effect, twice 100 ms)
*''Selected'' (long click >2 s): horizontally placed two rectangles to the right and left of the caption
*''Not selected'' (long click >2 s): there are no horizontally placed two rectangles to the right and left of the caption
 
Differences in voice control:
 
*The command to the voice assistant contains a description of the desired action and state, so it is faster
*The voice assistant understands different interpretations of actions and states, so there is no need to memorize voice commands
*During a voice call, not the entire menu is shown, but the corresponding items of the main menu and submenu
*The user can voice the display of the entire menu
 
{| class="wikitable"
{| class="wikitable"
|+
|+
! style="width: 20%" | Parameters
! style="width: 15%" |LMM
! style="width: 10%" | Raspberry Pi 4B
! style="width: 15%" |RSB
! style="width: 10%" | Intel Core i5-4250U
! style="width: 40%" |Action
! style="width: 10%" | Intel Core i7
! style="width: 30%" |Notice
! style="width: 10%" | Qualcomm
! style="width: 10%" | AMD Ryzen
! style="width: 10%" | AMD EPYC
! style="width: 10%" | Apple M1
!Intel Core i9
! style="width: 10%" | Intel Xeon Gold 6338
|-
|-
|Family
| rowspan="6" |MSG
|[https://www.cpu-monkey.com/en/cpu_family-broadcom_bcm Broadcom BCM]
(Messenger)
|[https://www.cpu-monkey.com/en/cpu_family-intel_core_i5 Intel Core i5]
|IMSG (instant messaging system)
|
|
|
|
|
|
|
*displays the [[Public:Applications#IMSG%20(Instant%20messaging%20system)|IMSG]] application in a window
|
|
*an IMSG application usually does not require the use of a fading window
|-
|-
|CPU group
|CHAT (multichannel chat)
|[https://datasheets.raspberrypi.com/bcm2711/bcm2711-peripherals.pdf Broadcom BCM2711], [https://www.cpu-monkey.com/en/cpu_group-broadcom_bcm2711-278 more]
|[https://www.cpu-monkey.com/en/cpu_group-intel_core_i_4000u-58 Intel Core i 4000U]
|
|
|
*displays the CHAT application in a window
|AMD Ryzen 5
*displays in the RFS (right features sidebar) field below the icons of several recently used chats (one-to-one and group)
|AMD EPYC 7713P
*if there are unviewed messages marked as important, the chat icons in the RFS field are displayed in red (automatic sorting of such chats)
|
*if there are messages that require a response, the chat icons in the RFS field are displayed in yellow (automatic sorting of such chats)
|
|LMM for all channels, RSB and RFS for the corresponding channel:
|Intel Xeon 3Gen [https://www.mouser.de/datasheet/2/612/3rd_gen_intel_xeon_scalable_processors_product_bri-2326885.pdf Gold 6338]
 
*A counter of notifications of messages requiring a response is displayed at the top (yellow color)
*Below is the number of unread messages (azure color)
|-
|-
|Architecture
|MAIL (eMail)
|AMD Cortex-A72
|Haswell U
|
|
|
|
|
|
|
*displays the [[Public:Applications#MAIL%20(eMail%20client)|MAIL]] application in a separate window
|
|
|-
|-
|Frequency
|SDR2 (SDR 2-way)
|1.5 GHz
|1.3-2.6 GHz
|
|
*displays the SDR2 application in a separate window
|
|
|
|
|
|
|2.0-3.2 GHz
|-
|-
|Cores
|CRPT (cryptologic control)
|4
|2
|
|
|
|
|
*launches the CRPT application in a separate window
|
|
|
|32
|-
|-
|Threads
|PTTH (PTT headset)
|2
|4
|
|
|
|
|
|
*uses the built-in headset function for a handheld portable or manpack radio connected with a 4-pin cable (1-ch) or 5-pin cable (2-ch); for the PTT ("push-to-talk") function, use the A button on the left headphones ear cup
*allows you to use a programmatic way, where instead of pressing, a voice command is used
|
|
|64
|-
|-
|RAM
|TSK (Tasks)
|8 Gb, 1ch, LPDDR4-2400
|16 Gb, 2ch, DDR3-1600
|
|
|
|
|
*OVDU (Overdue)
*ONGO (Ongoing)
*ASST (Assisting)
*SBME (Set by me)
*FLWG (Following)
*CMNT (Comments)
*DONE (Done)
|The task management system allows you to plan and control the deadline, accuracy, results, and efficiency of tasks. Contains a description, checklist, deadline, actual completion time and elapsed time (including auto-tracking of completion and accounting of elapsed time), notification of the current status, geolocation at the time of completion, task completion confirmation artifacts, attachments, comments
|
|
|
*In the upper right corner, a counter of notifications about overdue tasks and with an approaching deadline is displayed
|64+ Gb, DDR4
*The number of tasks for today is displayed in the lower left corner
|-
|-
|L2 cash
|CAL (Calendar)
|1 Mb
|
|
*DAY (Day)
*WEEK (Week)
*MNTH (Month)
*YEAR (Year)
|The event calendar allows you to plan and coordinate events in advance that require certain time regulations: collective online and offline communications, individual classes and trainings, meetings, training seminars, TDY (temporary duty) trips, and deployments
|
|
|
*In the upper right corner, a counter of notifications of upcoming events is displayed
|
*The number of events for today is displayed in the lower left corner
|
|
|
|48 Mb
|-
|-
|L3 cash
|WGR (Workgroups)
|
|3 Mb
|
|
|
|
|
|
|
*TAC (Tactical)
*ISR
*FSUP (Fire support)
*FAIR (Fast air)
*MAS (Medical assistance)
*EVAC (Evacuation)
*LOG (Logistic)
|The submenu contains filters for groups.
You can select a member or group in the appropriate section to communicate, share data, send or request a position. CDI element (Cross-Domain Interaction)
|
|
*The number of available group members is displayed in the upper right corner
*The number of active workgroups the user is a member of is displayed in the lower left corner
|-
|-
|PCIe ver
| rowspan="5" |MAP
(Maps & Navigation)
|CMPS (Compass)
|
|
|2.0
*displays the CMPS application in the LUW window
*shows azimuth and elevation in degrees
|
|
|
|
|
|
|
|4.0
|-
|-
|PCIe lanes
|NAV (Navigation)
|
|
|12
*displays the NAV application in a separate window
*allows using GPS or RDF (radio beacon triangulation) to determine the location on a local map
*allows you to calculate distances, travel time, perform route optimization
|
|
|
|
|
|
|
|64
|-
|-
|GPU
|PATH (Path tracking)
|iGPU [https://www.cpu-monkey.com/en/igpu-broadcom_videocore_vi-221 Broadcom VideoCore VI]
|iGPU [https://www.cpu-monkey.com/en/igpu-intel_hd_graphics_5000-58 Intel HD Graphics 5000]
|
|
|
|
|
|
|
*displays the PATH application in a separate window
*allows you to track the distance traveled and marks points on the map with the time
*integrated with the TSK application for automatic execution of tasks related to changing positions
|
|
|-
|-
|GPU Freq.
|PLAN (Mission planning)
|0.50 GHz
|0.20 GHz
|
|
|
|
|
|
|
*displays the PLAN application in a separate window
*allows to plan the mission in detail in terms of tasks (route, time, resources, targets, threats, communications, ISR tasks, logistics, necessary reports)
*integrated with BMS (Battlefield Management System) and TSK app
*integrated with L-STE (Live-Synthetic Training Environment)
|
|
*significantly optimizes time and resources, improves mission efficiency
|-
|-
|FP32
|ANLS (Mission analysis)
|32 GFLOPS
|640 GFLOPS
|
|
|
|
|
|
|
*displays the ANLS application in a separate window
*allows you to analyze the performance of the mission in real time, taking into account the deviation from the mission plan by different domains and divisions
*integrated with BMS (Battlefield Management System) and TSK app
*integrated with L-STE (Live-Synthetic Training Environment)
|
|
*significantly reduces risk and increases mission consistency
|-
|-
|Technology
| rowspan="7" |SINT
|28 nm
(SIGINT)
|22 nm
|SDRS (SDR Scan)
|
|
|
|
|
|
|
*displays the SDRS application in a separate window
*allows you to analyze radio frequency 2D / 3D spectrum and waterfall diagram in the range of 2 kHz - 6 GHz with different modulations
*allows you to listen to unencrypted analog and digital radio broadcasts
*allows you to analyze patterns of radio frequencies, incl. masked in bands not used for communications
*allows you to analyze the safest and most unloaded frequencies for communication, transponder (IFF), remote control (RC)
|
|
|-
|-
|Max displays
|RDF (Radio Direction Finding Control)
|2
|3
|
|
|
|
|
|
|
*displays the RDF app in an overlap mode in the IFF / NAV app window or in a separate window
*allows you to perform positioning in the conditions of a distorted GPS signal through triangulation by radio beacons
*allows you to determine the direction and distance to the source of the radio signal of interest, detected using the SDRS application
|
|
|-
|-
|Exec units
|PCSR (Passive covert radar control)
|4
|40
|
|
|
|
|
|
|
*displays the PCSR app in an overlap mode in the IFF / NAV app window or in a separate window
*allows using a passive program-controlled antenna to receive reflected radio signals in the FM range to detect aircraft and equipment, while not detecting itself (without using the radiation of the radio signal of its own radar)
|
|
|-
|-
|Shader
|RWRC (Radar warning receiver control)
|64
|320
|
|
|
|
|
|
|
*displays the RWRC app in an overlap mode in the IFF / NAV app window or in a separate window
*allows using a passive antenna to detect the radiation of directional radars and determine the course in relation to them
*integrated with the IMSG and TSK app for fast response to threats
|
|
|-
|-
|GPU memory
|APAR (Active phased array radar control)
|2 Gb (system memory)
|2 Gb (system memory)
|
|
|
|
|
|
|
*displays the APAR app in an overlap mode in the IFF / NAV app window or in a separate window
*allows remote control of an active radar at a safe distance
|
|
|-
|-
|Hw codec
|RFDD (RF Drone Detection Control)
|h264 / HEVC (8,10bit), VP9, VP8, AVC, VC-1, JPEG
|h264, AVC, VC-1, JPEG
|
|
|
|
|
|
|
*displays the RFDD app in an overlap mode in the IFF / NAV app window or in a separate window
*allows using a passive antenna to detect a radio signal between the drone and its operator, determine the distance
|
|
|-
|-
|[https://www.intel.com/content/www/us/en/support/articles/000055611/processors.html TDP] PL1
|EODD (RF EOD Detection Control)
|7.5W
|15W
|
|
*displays the EODD app in an overlap mode in the IFF / NAV app window or in a separate window
*allows using a portable wearable metal re-radiation radar (MET3R) to detect anti-tank mines, metal anti-personnel mines (including those with remote control), IEDs and trip wires
*integrate with CVC application for additional use of Computer Vision, especially against plastic anti-personnel mines
|
|
|
|
|
|
|205
|-
|-
|TDP PL2
| rowspan="4" |RC
|
(Remote Control)
|
|RPAC (Drone RC)
|
|
|
|
|
|
|
*displays the RPAC app in a separate window
*allows to control different models of drones using the built-in controller (land, waterborne and aerial drones)
*allows to use the tilt of the head as one of the manipulators (instead of the joystick) and the joystick on the right headphones ear cup to control
*allows to use one joystick to control two manipulators
*allows to use Hand Tracking to control software joysticks and buttons
*allows to use a voice assistant TESS and AI (Artificial Intelligence) technology for hands-free control
*allows to use built-in navigation without using a separate front-facing camera for navigation
|
|
|-
|-
|TDP up
|RBRC (Robot RC)
|
|
|
|
|
|
|
|
|
*displays the RBRC application in a separate window
*allows to remotely control the robot, similar to controlling a drone
|
|
|-
|-
|TDP down
|FTRC (Fire turret RC)
|3W
|
|
|
|
|
|
|
|
*displays the FTRC app in a separate window
*allows to remote control of the small arms turret
|
|
|-
|-
|ISA
|UVRC (Unmanned vehicle RC)
|ARMv8-A64 (64 bit)
|x86-64 (64 bit)
|
|
|
|
|
|
|
*displays the UVRC app in a separate window
*allows to remote control a vehicle, similar to controlling a drone and a robot
|
|
|-
|-
|ISA ext
|WIKI (Wiki)
|
|SSE4.1, SSE4.2, AVX2
|
|
|
|
|
|
|
*MAN (Manuals)
*RPT (Reports)
*ART (Articles)
*UPD (Updates)
*TUT (Tutorial)
|Wiki systems are proven to be effective in creating and sharing the knowledge that everyone needs on an almost daily basis. This system allows for to a collection of best practices and improves the process of learning and training, as well as refreshing knowledge from time to time even from experienced users. All sorts of information about the technical arrangement and maintenance of equipment, the organization of processes at military bases, schedules, analysis materials of military experts, etc. Something that will help you become more efficient. Of course, distributed access rights, information protection, and confidentiality are in accordance with current protocols
|
|
*The issues of security, protection against unauthorized access, confidentiality and ensuring uninterrupted access of users to the network, we intend to detail in a separate article.
*Most likely, this process will be transferred to the developers of one of the DoD agencies (CYBERCOM) and the NSA as part of a deployment of the system (I am sure that these issues will not be within our competence)
|-
|-
|Socket
| rowspan="3" |MMD (Multimedia)
|
|REC (multimedia recorder)
|BGA 1168
PLAY (multimedia player)
|
|
|
|
|
|
|
*launches the REC/PLAY app as the tab of the MMD app group window (tabs: REC, PLAY, VM, TRSL) or in a separate window
|
|
|-
|-
|OS
|VM (Virtual mentor incl. video chat)
|Linux, Win10
|Linux, Win10
|
|
|
|
|
|
|
*launches the VM app as the tab of the MMD app group window (tabs: REC, PLAY, VM, TRSL) or in a separate window
*video conferencing system that allows remote data streaming with video, voice, text and file sharing
*allows remote mentoring assistance in the context of medical care, incl. Care Under Fire, repair and maintenance of equipment, experienced mentors online to observe the training process and help correct mistakes
|
|
|-
|-
|Price
|TRSL (Translater)
|75€
|
|
*starts the TRSL application in the background without opening a window
*allows, based on the AI small language model, to translate the text, taking into account the context and specialized terms
*integrated with STT (speech-to-text) services and CV (Computer Vision) system to generate source material for translation
|
|
|
|
|
|
|
|3500€
|-
|-
|Extra
|FILE (File explorer)
|
|
|
|
*FAV (Favorites)
*FLR (Folders)
*CLD (Clouds)
*TAG (Tags)
|
|
*launches the FILE application in a separate window
*the specified filters allow to quickly and easily find the files you need
*additionally applies full text search, search by date, time, data format, size, author, etc.
|
|
|
|
|
|Intel Deep Learning Boost, Intel Crypto Acceleration
|}
* AMD M1 and M2 Apple
* AMD EPYC 7543P
=== GPU ===
*
=== RAM ===
* 8x DDR4 (Xeon 3Gen) = 64Gb-128Gb
=== VRAM ===
* 16Gb
=== DSP ===
*
=== SSD ===
*
=== Power supply ===
# 3x4 x Li-Ion 18650 3.7V 4000mah = 177,600wh
# 3x4 x Li-Ion [https://www.akkushop.de/de/26650-li-ion-akku-5000mah-mit-37-volt-max.-185wh-mit-usb-ladeanschluss/ 26650 3.7V 5000mah] = 222,000wh
# 3x4 x Li-Ion [https://www.akkushop.de/de/imr-26650-li-ion-akku-5500mah-36v-37v-15a-konstant-abmessungen-665-x-263-mm/?utm_source=criteo&utm_medium=retargeting&utm_campaign=lowerfunnel&cto_pld=_ZM4eBbeAABPaSy7OLdlPg 26650 3.6 5500mah] = 237,600wh
# 3x4 x LiFePO4 [https://www.manomano.de/catalogue/p/ifr32600-32v-33v-6000mah-lifepo4-lithium-eisenphosphat-akku-11700426 18650 3.2V 6000mah] = 230,000wh
=== More ===
# Qualcomm SOC - OS, проектор, камеры, мультимедиа, приложения
# NVIDIA SOC - GPU, VPU для обработки видео и Computer Vision
# SOC [https://www.mouser.de/datasheet/2/609/ADSP_21362_21363_21364_21365_21366-3121333.pdf 32-bit DSP] - для обработки аудио, фильтров, Computer Hearing
# SOC DSP - для SDR scan и 2-way connection
# SOC - для ? (radar detection, ...)
[https://www.arducam.com/product/arducam-48mp-ultra-high-resolution-motorized-focus-usb3-0-camera-evaluation-kit/ Камеры 48 MP] sensor [https://www.arducam.com/capturing-48mp-raw-images-with-arducam-usb-camera-dev-kit/ IMX586 based] (x24 for Full HD 2 MP), Sony SWIR ?
Ранец: 48 элементов питания, 2-3 литра воды с обратным клапаном, 4 антенны штырьевого типа (в т.ч. телескопическая с пневматическим приводом и ручной помпой)
Антенны:
# дипольное основание антенны с кабелем RG174 60 см
# две коротких сменных телескопических антенны от 5см до 13см
# две длинных сменных телескопических антенны от 23 см до 150см
# кабель-удлинитель RG174  3 метра
# присоска для крепления антенны
# мини-штатив для крепления антенны
# складывающаяся штырьевая HF антенна 1.5 и 3 м<ref>AT Communications, [https://at-communication.com/hf_ssb_antennas_portable/codan/hf_ssb_tactical_antennas_2110m.html Tactical HF Antennas]</ref>
# тактическая портативная HF антенна 50 Ohm 150W 2-30 MHz (подвесная / горизонтальная) NVIS (40-400 km), (1.3 кг)<ref>AT Communications, [https://at-communication.com/hf_military_antennas_portable/at/hf_ssb_antennas_at_swq.html SWQ-150M Antenna]</ref>
# дипольная HF антенна 50 Ohm 400W 2-30 MHz (горизонтальная / V-образная) 30 м (в сумке 5 кг)<ref>AT Communications, [https://at-communication.com/hf_military_antennas_portable/at/hf_ssb_antennas_att_fd.html Tactical HF antennas]</ref>
# Antenna, L-TAC® Dismount / Vehicular<ref>Inmarsat, [https://www.inmarsat.com/en/solutions-services/government/services/l-tac.html L-TAC], [https://www.inmarsat.com/content/dam/inmarsat/corporate/documents/government/solutions-services/Inmarsat_Global%20Government_L-TAC_August_2020_EN.pdf.coredownload.inline.pdf L-TAC page]</ref>
{| class="wikitable"
|+
!style="width: 10%" | Frq range
!style="width: 5%" | Band
!style="width: 10%" | Waves
!style="width: 10%" | Wave length
!style="width: 25%" | Networks
!style="width: 20%" | Avg range (terrain / city)
!style="width: 20%" | Antenna types
|-
|2-30 MHz
|HF
|Dekameter
|100-10m
|Long range comms (2-30), RB, CB (25.6–30)
|0-100 km BLOS
100-500 km BLOS
500+ km BLOS
(100-125W)
|Ribbon type, 1.5 m
Folding pin, 1.5m
Telescopic pin, 3 m
Broadband (from the end)
Wideband Dipole
|-
|30-300 MHz
|VHF
|Meter
|10-1m
|Middle range comms (30-88, 118-174, Narrowband: 30-225), TVm, RB (88-108), Aircraft nav (108-118, 225-400), Amateur (144-146), Emergency services (146-200), Train services (151-155), Water transport (156-158, 300-302)
|6-8 miles LOS (5W): handheld-to-handheld
10-15 miles LOS (10-25W) vehicle-to-vehicle
15-20 miles LOS (50W) vehicle-to-base
|pin 162-714 MHz, 5.3<nowiki>''</nowiki>
pin 150-174 MHz, 9<nowiki>''</nowiki>
pin 150-162 MHz, 5.6<nowiki>''</nowiki>
pin 136-151 MHz, 6.2<nowiki>''</nowiki>
|-
|300-3000 MHz
|UHF
L
|Decimeter
|1-0.1 m
|Short range comms of narrowband Line-Of-Sight (LOS) (225-512, Wideband: 225-450, Highband: 512-520 & 762-870), MUOS SATCOM Beyond-Line-Of-Sight (BLOS) (300-320 UL, 360-380 DL), UHF SATCOM Beyond-Line-Of-Sight (BLOS) (291-318.3 UL, 243-270 DL), L/S-band  Beyond-Line-Of-Sight (BLOS) (1300-2600), TVdm, RB, Commercial (400-500), Amateur (433-434), LTE (806-825, 851-870, 900, 1800), 5G, GPS, Wi-Fi<ref>Wikipedia, [[wikipedia:Long-range_Wi-Fi|Long-range Wi-Fi]]</ref><ref>Wikipedia, [[wikipedia:Point-to-point_(telecommunications)|Point-to-point telecomms]]</ref> (IEEE 802.11: 2.4, 5.8 GHz), Bluetooth
|UHF: 3-6 miles LOS (0.25-5W), (20W peak)
UHF SATCOM: BLOS (10-20W)
MUOS SATCOM: BLOS (10-20W)
L/S-Band: BLOS (3.2W)
WiFi: 2-8 miles LOS
LTE: 1-4 miles LOS
5G: 1-4 miles LOS
Bluetooth: 400 m LOS
|pin 378-430 MHz, 6.3<nowiki>''</nowiki>
pin 378-403 MHz, 3.0<nowiki>''</nowiki>
pin 403-430 MHz, 2.8<nowiki>''</nowiki><ref>L3Harris, [https://www.l3harris.com/all-capabilities/xg-25p-two-way-portable-radio-antennas XG25p Antennas]</ref>
pin 440-494 MHz, 2.4<nowiki>''</nowiki>
pin 764-870 MHz, 6.7<nowiki>''</nowiki>
pin 764-870 MHz, 3.7<nowiki>''</nowiki>
L-TAC Mainpack / Vehicular
MUOS antenna
Wi-Fi directional antenna
|-
|-
|3-30 GHz
| rowspan="7" |PROC (Processing Control)
|SHF
|CVC (Computer Vision Control)
|Centimeter
|10-1 cm
|Sat comms, radars, TV sat
|
|
*launches the CVC app in an overlap mode in the CAM app window
*allows to configure of presets and additional widgets for simultaneous use with other apps in the same window (overlapping) and use the streaming data of these apps
*applies AI methods
*allows to flexibly configure the rules for using your own, cloud and peer-to-peer (P2P network) computing resources
*allows to configure methods and conditions for optimizing loads in different cases
|
|
|-
|-
|30-300 GHz
|CAC (Computer Audition Control)
|EHF
|Millimeter
|10-1 mm
|
|
|
*launches the CAC app in an overlap mode in the CAM / IFF / NAV apps window or in a separate window
*allows to customize presets and AI algorithms
*allows load optimization for different apps
|
|
|}
== Interface Items Motion ==
* принципиальный вид
* активный вид при работе с меню
* процесс выбора пункта меню (скролл элементов, изменение вида при входе в подменю 1-го уровня / 2-го уровня / 3-го уровня)
* постоянный (продолжительный) вид (статусы, нотификации, активные пункты меню)
* включение и смена затухающих окон (правила, варианты комбинации в одновременном виде)
== User Interface Scripts ==
=== Review ===
{| class="wikitable"
|+
!style="width: 35%" |Action
!style="width: 15%" |Voice command
!style="width: 15%" |Hand gestures
!style="width: 35%" |Notices
|-
|-
|Включение устройства и самотестирование
|IFF (IFF Control)
|
|
|
*launches the IFF application in a separate window
*allows using transponder data of other users and generalized data of other detection systems (SDRS, RDF, CVC, CAC, PCSR, RWRC, APAR, RFDD, satellite data, and data of other users) in the navigation mesh mode
*allows to automatically and manually mark the statuses of detected people, vehicles and objects
*applies AI methods
|
|
|-
|-
|окна с затемнением
|STM (Stealth Modes Control)
|
|
|
*launches the STM application in a separate window
*allows you to configure presets for different stealth modes for the radio
|
|
|-
|-
|Статусы: заряд, время, дата,
|FA (Firing Assistance Control)
|
|
|
*launches the FA app in an overlap mode in the CAM app window
*allows to execute real-time of ballistic calculations for small arms and mortar fire
*allows to use all types of sighting devices
*allows to configure presets and a widget to work with other applications in the same window at the same time and use the streaming data of these apps (drone / robot / turret cams view)
*applies AI methods
|
|
|-
|-
|Настройка: уровни громкости наушников
|VBS (Vitals Body Sensors Control)
|
|
*launches the VBS app in a background ormode  in a separate window
*allows to set up presets and integration with sensors
*allows accurate monitoring of vital signs in any position and on the move
*based on Machine Learning algorithms and medical scientific data, it assesses the presence of dangerous and critical conditions, in the event of which it sends messages and independently controls medical devices (automatic tourniquets, difibrillator as cardio resuscitation and after support, fluid resuscitation, pulmonary resuscitation)
*applies AI methods
|
|
|settings, отдельно слева и справа
|-
|-
|Настройка параметров экрана
|ANTC (Antennas Control)
|
|
*launches the ANTC app in a separate window
*based on the built-in VNA antenna analyzer, determines the impedance (impedance factor), SWR (standing wave ratio for matching with the feeder path), radiation pattern, gain, and other characteristics of retractable and software-defined antenna for tuning in a specific radio session
*advises the user on antenna tuning recommendations or controls the software-defined antenna itself
|
|
|settings
|-
|-
|Настройка: проверка интеграции с другими устройствами
|DVC (Integrated devices)
|
|
|
|devices
*SGHT (Digital sights driver settings)
|-
*DRON (Drones and bots driver settings )
|Настройка: проверка доступных сетей
*RADR (Radars driver settings)
*SENS (Other Sensors driver settings)
|
|
*launches the ANTC app in a separate window
*allows to configure integration with external devices
*allows to download new drivers and test functionality directly on the device to find errors
*allows to roll back (undo) to the previous driver in specific specified cases
|
|
|networks
|-
|-
|Настройка: приложения
|NET (Networks)
|
|
*VHF
*UHF
*HF
*3/4/5G
*WLAN
*BT
*P2P
|
|
|apps
*launches a NET app in a separate window
|-
*allows to connect and disconnect for wireless networks, analyze network bandwidth, set network selection priorities for each type of data and for each app
|Настройка: виджеты
*allows real-time analysis of data exchange across networks
*allows to configure rules for P2P networks, participants, resource allocation for multi-party computing, rules for user view exchange
|
|
|
|widgets
|-
|-
|Обзор папки с документами
| rowspan="14" |SYS (System)
|CAM (Cameras Control)
|
|
*launches the CAM app in a separate window or in multiple windows at the same time
*allows to set up presets and integration with other apps
*allows to perform digital zoom, interpolation to improve image quality and edge detection, use filters, deep processing of images and real-time video, mix channels and signals from 4 different sensors
*dynamically detect contours and highlight them on the screen
*calibrate and adjust the stereo camera for accurate distance measurement
*integrated with other applications to use external cameras, Computer Vision technologies, Fire Assistant
|
|
|folder
|-
|-
|Настройка камер и включение режима записи фото и видео, режим передачи
|DISP (Display Control)
|
|
*launches the DISP app in a separate window
*allows to customize presets and work with different apps
|
|
|camera
|-
|-
|Включение громкоговорителя
|FPAD (Fading Pads Control)
|
|
|
*launches the FPAD app in a separate window
*allows ou to customize presets and work with different apps
|
|
|-
|-
|Включение фронтального света
|MMC (Multimedia Control)
|
|
|
*launches the MMC app in a separate window
|
*allows to customize presets and work with different applications for multimedia devices: headphones (2), embedded microphones (11), handheld radio via built-in headset and voice software headset, loudspeaker (1)
|}
|11 embedded microphones:


=== Situational Awareness (SA) ===
*6 omnidirectional (built-in airway obturator, boom microphone with a windproof pad on the flexible goosneck, front, left and right headphones ear cups, back)
{| class="wikitable"
*2 super-cardioid (front, -35 / +35° angle)
|+
*3 ultra-cardioid (front, -10 /0 / +10° angle)
!style="width: 35%" |Action
!style="width: 15%" |Voice command
!style="width: 15%" |Hand gestures
!style="width: 35%" |Notices
|-
|Frontal camera view
|tess frontal view on / off
|
|frontal view
|-
|-
|Frontal camera zoom
|TESS (Voice assistant)
|tess zoom x8
|
|
|zoom param
*launches the TESS app in a separate window for configuration and management
|-
*this application is a small language model with the possibility of learning on the dataset of a specific user and many users of this platform
|Обзор заднего вида
*applies AI methods
|tess rear view on / off
|
|
|rear view
|-
|-
|Вид с внешней камеры дрона
|HT (Hand tracking system)
|tess drone alpha view
|
|
|drone param view
*launches the HT app in a separate window for configuration and management
|-
*this application is based on Computer Vision technology for recognition of the user's hands in the field of view of a stereo camera
|Вид с внешней камеры другого пользователя
*has the ability to learn new gestures on the dataset of a particular user and many users of this platform
|tess user tango four view
*applies AI methods
|
|
|user param view
|-
|-
|Вид с внешней камеры цифрового прицела
|STT (Speech-to-text settings)
|tess scope view on / off
|
|scope view
|-
|Ночное зрение
|tess night view on / auto / off
|
|night view
|-
|Тепловизионная камера, режим термографии
|tess thermal view on / off
|
|thermal view
|-
|Тепловизионная камера, режим контуров
|tess contour view on / off
|
|thermal contour view
|-
|Смешанное зрение (set A, set B, set G, etc.)
|tess mixed alpha view on / auto / off
|
|zoom, night vision, thermal image vision, reticle, range
|}
 
=== Communication (Comms) ===
{| class="wikitable"
|+
!style="width: 35%" |Action
!style="width: 15%" |Voice command
!style="width: 15%" |Hand gestures
!style="width: 35%" |Notices
|-
|Выбор каналов связи
|
|
|
*launches the STT app in a separate configuration and management window
*has the ability to adapt to different pronunciations
*integrated with the TESS application for perception of text in the context of semantic categories
*applies AI methods
|
|
|-
|-
|Приоритет каналов связи
|VOVR (Voiceover settings)
|
|
|
*launches the VOVR app in a separate window
*allows you to speak text and commands in multiple voices
|
|
|-
|-
|Проверка доступных абонентов
|INP (Joystick and buttons settings)
|
|
|
*launches the INP app in a separate window
*allows you to configure and calibrate physical and software input devices: buttons and joysticks
|
|
|-
|-
|Сессия: чат
|GNSS (GNSS)
|
|
*launches the GNSS app in a separate window
*allows you to set up communication with geospatial positioning satellites (GPS, Galileo, QZSS), track positioning errors, issue messages to the user
|
|
|chat: дополнительные окна справа снизу
|-
|-
|Сессия: голосовой чат
|ACC (Accounts & Sync)
|
|
*launches the ACC app in a separate window
*manages the user profile and authorizes it to access cloud data on the network and within the peer-to-peer network
|
|
|voice chat: преобразование в текст
|-
|-
|Сессия: icon messages
|SEC (Security)
|
|
*launches the SEC app in a separate window
*allows to configure: password, emergency alert, emergency SOS, lock & unlock
*must comply with the requirements of security, data protection, established by the protocols of defense agencies and information security agencies
|
|
|icon chat:
|-
|-
|Настройка режимов шифрования и обмена ключами
|ADM (Admin only)
|
|
|
*launches the ADM app in a separate window
*provides access to administrators, incl. remote access, for error control, correction and user assistance, as well as for maintenance and updates
|
|
|-
|-
|Управление несколькими активными каналами
|SRV (Services)
|
|
|
*launches the SRV app in a separate window
*allows administrators to configure the operation of software services and embedded devices: Time and Date, Notifications, LED Spotlight settings (SPOT), Battery saver (BSVE), Water saver (WSVE), Accelerometer, Gyroscope, Hall sensor, Barometer, Thermometer, Ambient light sensor, Humidity sensor, Gas sensor (CO, NO2), Radiation sensor
*launches scheduled calibration, automatically sends a report to the analytical system
|
|
|}
|}


=== Navigation (Nav) ===
===Left quick menu (LQM)===
Displays hides (within a frame) and open app windows on the left half of the screen. To completely stop the app, you need to perform a long click and press confirmation in the notification window.
 
===Right quick menu (RQM)===
Displays hides (within a frame) and open app windows on the right half of the screen. To completely stop the application, you need to perform a long click and press confirmation in the notification window.
 
===Left features sidebar (LFS)===
Displays:
 
*functional buttons of some active apps in the left half of the screen, when there are a lot of them and it is undesirable to reduce the visible area of ​​the application window
*list of priority tasks for the TSK application
*list of recently viewed articles for the WIKI app
*list of peer-to-peer leads for P2P application and their real-time characteristics
*priority channel list for WGR application
 
===Right features sidebar (RFS)===
Displays:
 
*function buttons of some active apps in the right half of the screen, when there are a lot of them and it is undesirable to reduce the visible area of ​​​​the application window (for example, SDRS)
*CHAT app dialog list and dialog filters
*list of recent commands via the IMSG app
*list of taken photos and videos for the PLAY application
*list of video conferencing participants for VM application
 
===Virtual control tools===
Displays:
 
*Software (duplicated and synchronized with hardware) joysticks and buttons for controlling a drone, robot, turret, unmanned vehicles
*Software buttons for controlling cameras of drones, robots and unmanned vehicles
*Joysticks and buttons to control the movement of positions on the map and mark waypoints
*Multimedia control and navigation buttons
 
==Windows items description==
{{further|1=[[Public:Applications]]|2=|3=|4=|5=|6=|7=|8=|9=|10=}}
 
===Fading windows and pads===
<br>
[[File:Pads-100-3.jpg|center|frameless|950x950px|Pads-100]]
<br>
 
{| class="wikitable"
{| class="wikitable"
|+
|+
!style="width: 35%" |Action
! colspan="2" |Left
!style="width: 15%" |Voice command
! colspan="2" |Center
!style="width: 15%" |Hand gestures
! colspan="2" |Right
!style="width: 35%" |Notices
|-
|-
|Включение поля компаса
|LMMP
|
|Left main menu fading pads
|
|SBP
|compass
|Status bar fading pads
|RSBP
|Right submenu fading pads
|-
|-
|Включение поля линии взгляда
|LQMP
|
|Left quick menu fading pads
|
|CLW
|
|Central left window
|RQMP
|Right quick menu fading pads
|-
|-
|Виды навигационной сетки
|LFSP
|
|Left features sidebar fading pads
|
|CRW
|
|Central right window
|RFSP
|Right features sidebar fading pads
|-
|-
|Масштабирование навигационной сетки
|LUW
|
|Left Upper window
|
|CWJP
|
|Central window joystick pads
|RUW
|Right Upper window
|-
|-
|Режим IFF
|LTAW
|
|Left Top A window
|
|CWBP
|reticle
|Central window buttons pads
|RTAW
|Right Top A window
|-
|-
|Просмотр плана местности, собственные координаты, позиционирование
|LTBW
|Left Top B window
|
|
|
|
|location plan
|RTBW
|Right Top B window
|-
|-
|Планирование и отслеживание маршрута
|LBAW
|Left Bottom A window
|
|
|
|
|path tracking
|RBAW
|Right Bottom A window
|-
|-
|Отправка собственных координат другому пользователю
|LBBW
|
|Left Bottom B window
|
|
|
|
|RBBW
|Right Bottom B window
|}
|}
=== Intelligence, Surveillance, Reconnaissance (ISR) ===
As it was already written at the very beginning of the description of the user interface, fading windows and pads are used in the device for contrast display. Otherwise, on a light and bright background of the environment, it will be difficult for the user to see images with contrast. Fading windows and pads, depending on the brightness modes, have different degrees of transparency. And in the case of bright light, they additionally perform the function of a sun screen.
 
App windows are placed in a larger and better viewable area. There are 12 independent windows in total (8 large 1.78:1, 2 large 1.20:1, 2 small 19.86:1), each containing control elements when the window is clicked or voice selected (selected state). A non-selected window is a passive window that only displays app graphics, window control elements can be hidden, app control elements can be hidden. Windows of different apps have different display priority, which is configured in the system settings for each application. Depending on the selected preset in the Status bar (SB), the configurations of the displayed windows can be quickly and flexibly changed by the user.
 
<u>'''(!) Insert gallery with pictures of examples'''</u>
 
 
 
 
Window subelements are controlled by clicking (joystick, gesture control) or by voice. States:
 
*''Hover state:'' thick dotted line along field border
*''Click state:'' frame on the field border (animation effect, twice 100 ms)
*''Selected'' (long click >2 s): sparse dotted line along field border
*''Not selected'' (long click >2 s): no dotted line
 
Differences in voice control:
 
*The command to the voice assistant contains a description of the desired action and state, so it is faster
*The voice assistant understands different interpretations of actions and states, so there is no need to memorize voice commands
 
The user can quickly and flexibly control the window configuration for each window individually:
 
*The user can force close any window at any time by selecting the desired window (selected state), clicking on the "close window" icon (the app remains in the background, the app window is in a hidden mode, to reverse the action, click on the icon in the quick selection menu)
*The user can maximize the left or right central window (CLW, CRW) to the entire area of ​​the central window (CW) (merged window will be 2.40:1) by selecting the desired window (selected state), clicking on the "maximize window" icon
*The user can maximize the left or right window (LTAW, LTBW, LBAW, LBBW, RTAW, RTBW, RBAW, RBBW) to the entire left or right area of ​​the window (LW or RW) (merged window will be 1.78:1 x2) by selecting the desired window (selected state), clicking on the "maximize window" icon
*When you click on the "minimize window" icon, the window returns to its original state
*The "move window left" icon moves a window to the left, then up to the right, then to the left, changing the position of other windows
*The "move window right" icon moves a window to the right, then down to the left, then to the right, rearranging other windows
*The "share screen" icon allows you to send a screenshot of a window or enable broadcasting of this window for another user
 
===Apps priority for windows===
<br>
[[File:Apps priority v1.jpg|center|frameless|950x950px]]
<br>
 
{| class="wikitable"
{| class="wikitable"
|+
!style="width: 35%" |Action
!style="width: 15%" |Voice command
!style="width: 15%" |Hand gestures
!style="width: 35%" |Notices
|-
|-
|Сканирования области радиочастот, waterfall
| colspan="2" |'''LUW'''
|
|'''CLW'''
|
|'''CRW'''
|
| colspan="2" |'''RUW'''
|-
|Сканирование позиции видимого объекта и передача его координат
|
|
|
|-
|-
|Детекция объекта и измерение расстояния
| colspan="2" |
|
#CMPS
|
|
|-
|Просмотр детекций, сделанных другими пользователями группы
|
|
|
#CAM (sight view, 2:1 maxi)
#RPAC (drone view) / RBRC / FTRC / UVRC
#EODD
|
|
#CAM + FA + CVC widgets
| colspan="2" |
#NOTS (notifications, system messages)
#TIPS (user tips) + CHAT (new messages)
|-
|-
|Запрос на обнаружение и детекцию для других пользователей, групп и доменов
|'''LTAW'''
|
|'''LTBW'''
|
|'''CWJP (left)'''
|
|'''CWJP (right)'''
|}
|'''RTAW'''
=== Firing Assistance (FA) ===
|'''RTBW'''
{| class="wikitable"
|+
!style="width: 35%" |Action
!style="width: 15%" |Voice command
!style="width: 15%" |Hand gestures
!style="width: 35%" |Notices
|-
|-
|Включение прицельной сетки
|
|
#none
#TSK (2:1)
#DVC
#SYS
|
|
#none
#P2P
#WGR
#CAL
#WIKI (1:1, 2x)
#FILE (1:1, 2x)
|
|
|-
#RPAC / RBRC / FTRC / UVRC
|Включение баллистических параметров и режимов
|
|
#RPAC / RBRC / FTRC / UVRC
#SDRS
|
|
#none
#CVC (setup)
#CAC (setup)
#FA (setup)
#NET (setup)
#SDR2 (setup)
#ANTC (setup)
#STM (setup)
#CRPT (setup)
|
|
#IMSG
#SDRS
#CHAT (1:2 maxi)
#MAIL (1:2 maxi)
|-
|-
|Ввод данных для баллистических расчётов
|'''LBAW'''
|
|'''LBBW'''
|
|'''CWBP (left)'''
|
|'''CWBP (right)'''
|'''RBAW'''
|'''RBBW'''
|-
|-
|Помощь в совмещении линии прицела и целеуказания
|
|
#CAM (RHD, (another) user view, drone view)
#MAP (NAV, PATH, PLAN, ANLS)
|
|
#IFF
#CA widget
#RDF
#RFDD
#RWRC
#PCSR
|
|
|-
#RPAC / RBRC / FTRC / UVRC
|Корректировка выстрела
|
|
|
|-
|Быстрый доступ к истории выстрелов
|
|
|
|-
|Список целей и приоритеты
|
|
|
|-
|Список поражённых целей и подтверждений
|
|
|
|-
|Отслеживание боезапаса и запросы других пользователей / от других пользователей
|
|
#RPAC / RBRC / FTRC / UVRC
#SDRS
|
|
#RPAC (drone view) / RBRC / FTRC / UVRC
#CAM (RHD, (another) user view, drone view)
#MAP (NAV, PATH, PLAN, ANLS)
#MMD
#VBS
|
|
#CHAT (1:1 mini)
#MAIL (1:1 mini)
|}
|}
=== Task Management Tools (TM) ===
 
{| class="wikitable"
{| class="wikitable"
|+
|+
!style="width: 35%" |Action
!Window
!style="width: 15%" |Voice command
!Mode
!style="width: 15%" |Hand gestures
!Notice
!style="width: 35%" |Notices
|-
|-
|Уведомления
|Left Upper window (LUW)
|Usually used for a long time
|
|
|
|notification
|-
|-
|Управление задачами
|Left top A window (LTAW)
|Used when necessary, not recommended during intense combat so as not to limit the visibility of the environment
|
|
|
|tasks
|-
|-
|Управление расписанием
|Left top B window (LTBW)
|Usually used for a short time so as not to restrict the visibility of the environment
|
|
|
|calendar
|-
|-
|Управление рабочими группами
|Left bottom A window (LBAW)
|Usually used for a long time
|
|
|
|workgroups: настройка прав и правил для обмена данными, коммуникации
|-
|-
|Доступ к Вики
|Left bottom B window (LBBW)
|Usually used for a long time
|
|
|
|wiki
|-
|-
|Поиск
|Central left window (CLW)
|Usually used for a short time so as not to restrict the visibility of the environment
|
|
|
|loop
|-
|-
|Акцепт задачи
|Central right window (CRW)
|
|Usually used for a long time
|
|
|
|-
|-
|Делегирование задачи другому пользователю
|Right Upper window (RUW)
|
|Usually used for a long time
|
|
|-
|Запрос утверждения задачи
|
|
|
|-
|Утверждение задачи для другого пользователя
|
|
|
|-
|Мониторинг списка задач другого пользователя
|
|
|
|-
|Мониторинг списка задач группы
|
|
|
|
|-
|-
|Автотрекинг выполнения задач и событий расписания, просмотр отчёта
|Right top A window (RTAW)
|
|Usually used for a short time so as not to restrict the visibility of the environment
|
|
|
|}
=== Vitals Body Sensors and First Aid ===
{| class="wikitable"
|+
!style="width: 35%" |Action
!style="width: 15%" |Voice command
!style="width: 15%" |Hand gestures
!style="width: 35%" |Notices
|-
|-
|
|Right top B window (RTBW)
|
|Used when necessary, not recommended during intense combat so as not to limit the visibility of the environment
|
|
|
|-
|-
|
|Right bottom A window (RBAW)
|
|Usually used for a long time
|
|
|
|-
|-
|
|Right bottom B window (RBBW)
|
|Usually used for a long time
|
|
|
|}
|}
===Movement of windows to the left and right===
*General rule "left to right, top to bottom" (''list moving'' of 10 windows):
**LTAW - left top window A
**LTBW - left top window B
**LBAW - left bottom window A
**LBBW - left bottom window B
**CLW - central left window
**CRW - central right window
**RTAW - left top window A
**RTBW - left top window B
**RBAW - left bottom window A
**RBBW - left bottom window B
*If the active window is on the left side and it moves to the left, it moves up the list
*If the active window is on the left side and it moves to the right, it moves down the list in the left side, then from the left to the right in the center of the screen, then moves down the list in the right side
*If the place where the active window is moved is not occupied by another window, other windows do not change their position
*The other displayed window that the active window is moved down the list to is automatically moved up the list and takes the previous position of the moved active window
*The other displayed window that the active window is moved up in the list to is automatically moved down the list and takes the previous position of the moved active window
*Typically less than 10 large windows are displayed at the same time, so moving the active window does not move most other windows
*If all 10 large windows are displayed, move the active window by several positions in the list causes the neighboring window to be sequentially automatically temporarily moved, which then returns to the previous position again
*If the window is maximized and need to move, it is automatically minimized and moved according to the general rule, if necessary, it must be maximized manually again
*The user can select two or more windows at the same time by holding down the D key (near the joystick) right headphones ear cup (similar to the right mouse button)
*By selecting a window and holding down the C key (similar to the left mouse button) right headphones ear cup, the user can move the window or several windows at the same time with one action using the joystick - in this case, if a group of windows is moved, they will be located sequentially next to the list (even if in their previous location, they were not sequentially next to each other in the list)
*Small windows (LUW and RUW) move only to the left or right in place of a similar small window
*If the small window is moved to the right, the other window is moved to the left (swap)
*If an app launches a small window while both small windows are displaying information from other applications, then the window with the app with the lowest priority is hidden in the shortcut menu (LQM or RQM)
*If one small window closes, nothing is displayed in its place, to display the window of another app in this place, you need to click on it in the quick menu (LQM or RQM) or in the main menu (LMM and then RSB)
*If an app launches a window that has a higher priority than an already occupied window, then the lower priority window is moved to another location, as dictated by the window and app priority rules. When closing a window with a higher priority, the window configuration returns to the previous state
*If an application launches a window when there is no free more space to display windows, the window with the lowest priority is hidden automatically in the quick menu (LQM or RQM). When you close one of the windows with a higher priority, the previous window display state is restored. If you need to display a window with a lower priority, you need to make free space for it by minimizing one of the windows in the quick menu (LQM or RQM)


== User Interface Menu ==
''<u>Scrolling the window by (4/5 of the window height or in rows - adjustable individually)</u>'' is done using the up and down icons (scrollbar) or the joystick buttons "< +" and "->" from the bottom of the left or right headphones ear cup (similar to the PageUp, PageDown mouse buttons). Also smooth scrolling of the window with a joystick, voice command or gesture (including a virtual joystick or a separate gesture).
 
=== Status bar ===
12 elements. Видимы постоянно. Вмещает 6-7 символов.
 
* отображение переключается при коротком нажатии или голосовом вызове
* 1 раз в 5 мин показывает попеременно все активные состояния (автоскролл снизу вверх)
* пункт меню включается и выключается долгим нажатием или голосовой командой
* в некоторых элементах в правом нижнем углу иконка (камера, дисплей, мультимедиа и т.д.)
* функции вкл., выкл. озвучиваются
# Time / Date:
## Time (type 12:03am) - время показывается постоянно, автоскролл не выполняется
## Date (type 05/17we)
# Brightness
#* Яркость и затемнение (пэдс и все окна как солнцезащитные очки) - настраиваемые пресеты, по умолчанию:
## Ясный день - пэдс 50%, яркость 100%, все окна 25%
## Облачность - пэдс 25%, яркость 75%, все окна 0%
## Сумерки - пэдс 0%, яркость 75%, все окна 0%
## Темная ночь - пэдс 0%, яркость 50%, все окна 0%
## Ночные огни - пэдс 50%, яркость 75%, все окна 0%
## Ослепляющий день - пэдс 75%, яркость 100%, все окна 75%
# Cam mode (abbr)
#* Камеры могут быть совмещены в одном окне или отображаться синхронизированно на соседних окнах (линия зрения одна и та же). Зум может быть синхронизирован или управление зумом может быть по-отдельности (так легче ловить прицельную точку, например).
## FRHD (front HD stereo cam) - automatically turns on Central A+B displays (CD-AB), last used state of zoom, zoom control at the bottom right of the screen
## RRHD (rear HD cam) - automatically turns on Left Bottom A display, last used state of zoom, zoom control at the bottom right of the screen
## SWIR (day and night view) - по умолчанию выводится на центральный дисплей B, в то время, как HD изображение на дисплее A
## LWIR (thermal image view) - по умолчанию выводится на центральный дисплей B, в то время, как HD изображение на дисплее A
## SLTM (silhouette mode for thermal image view) - по умолчанию выводится на центральный дисплей B, в то время, как HD изображение на дисплее A
## MXSL (mixed vision mode: SWIR + LWIR)
## MXSS (mixed vision mode: SWIR + SLTM)
## PRS (passive radar sensor)
# Display modes
## DSOFF (turns off all displays) - отключает все активные окна
## CDS-A (display A On, display B Off) - при долгом нажатии запрос для выбора режима камеры или отключения
## CDS-B (display B On, display A Off) - при долгом нажатии запрос для выбора режима камеры или отключения
## LBDS-A (Left Bottom A display On / Off) - включается автоматически, при отключении выключает камеру заднего вида, если она была включена, при повторном включении запрос пользователю о необходимости включить камеру заднего вида
# Integrations
## HHR (portable handheld radio)
## RPA (remotely piloted aircraft controller)
## BOT (robot controller)
## P2P (p2p network)
# Multimedia
## LSPK (loudspeaker On / Off)
## EARL (Left On, Right Off) - при отключении включает правое ухо автоматически
## EARR (Left Off, Right On) - при отключении включает левое ухо автоматически
## VOL25
## VOL50
## VOL75
## VOL100
# Computer Hearing modes
## AUF1 (augio filter)
# Computer Vision modes
## CVRF (rangefinder On / Off) - при включении FA включается автоматически
## CVOR (object recognition mode)
## CVFR (face recognition mode)
# FA (fire assistance)
## FAM - включает перекрестие в главном окне, выводит баллистические параметры в правом субменю
## FAS - дополнительно отображает линию цифрового прицела
# Headlight (icon)
# Stealth modes (icon)
## Off
## Restricted, IFF off
## On
# Signal levels (icon)
# Battery (icon) - при остатке заряда менее 20% начинает моргать каждую минуту в течение 15 сек.
'''''Questions for mentors and experts:'''''


* Следует ли некоторые элементы меню показывать внутри поля попеременно автоматически? Например, активные сети, активные интеграции.
Window control icons, app control icons, app interface buttons located on the Left Features Sidebar (LFS) or Right Features Sidebar (RFS), virtual joysticks - refer only to the active (selected) window. For a passive window (not selected), they are not displayed. The exceptions can be customized, for example CHAT icons in RFS.
* Нужно ли регулировать уровень громкости спикерфона или всегда включать на полную мощность?


== Fading Pads ==
Separately for the window control icons - after the window has become active (selected), the window control icons are displayed for 15 seconds, after which they disappear (it can be in the settings disabled). To re-display them, select this window again. The active window's dotted highlight box is displayed for the duration of the window's active state.
Управляется микроконтроллером, который подаёт потенциал на каждую площадку по-отдельности. Земля общая (движение тока по пути наименьшего сопротивления). Разный потенциал создаёт разную степень затемнения (25%, 50%, 75%, 100%).


Процесс изготовления затемняемых областей экрана (окон) похож на процесс производства гибкой печатной платы:
For the not selected state you can click on another place on the screen or press the D button on the right headphones ear cup without click.


* Прозрачная основа A обезжиривается
{{#info-tooltip: More info}} <span style="background-color:#fff3bc">''Also, forced use of some windows can act as a sunshield when the sun is low on the horizon in the line of sight. The user can move the window to the desired area and block the dazzling view of the sun without fading the entire viewing area.''</span>
* На внутреннюю сторону основы A наносится полимерный состав электрохромного материала ([https://ru.wikipedia.org/wiki/%D0%A3%D0%BC%D0%BD%D0%BE%D0%B5_%D1%81%D1%82%D0%B5%D0%BA%D0%BB%D0%BE PDLC, SPD]) с помощью шелкографии (пэды и окна)
* Высушивается и наносится фоторезист
* УФ-лазером отверждается позитивное изображение
* Смывается незасвеченный фоторезист
* Незакрытые области вытравливаются в химическом растворе
* Смываются остатки фоторезиста
* На внешнюю сторону основы A через трафарет наносится [https://ru.wikipedia.org/wiki/%D0%9F%D1%80%D0%BE%D0%B7%D1%80%D0%B0%D1%87%D0%BD%D1%8B%D0%B5_%D0%BF%D1%80%D0%BE%D0%B2%D0%BE%D0%B4%D0%BD%D0%B8%D0%BA%D0%B8 прозрачный электропроводящий слой] - [[wikipedia:Transparent_conducting_film#Transparent_conducting_oxides|TCF]] (дорожки)
* Также на внутреннюю сторону основы B через трафарет наносится прозрачный электропроводящий заземляющий слой (дорожки)
* Вариант: заземляющий слой на внутреннюю сторону A повсеместно после травления до смывания фоторезиста, а на внутреннюю сторону B сигнальные дорожки, контактные площадки которых закрываются фоторезистом, а остальная поверхность покрывается изолирующим лаком, после смывания фоторезиста со стороны B контактные дорожки дополнительно утолщаются через трафарет. Эта версия позволяет отказаться от переходных отверстий!
* Готовая основа A + B спрессовывается в вакууме (в изогнутом виде)
* Делаются переходные отверстия между дорожками ?
* Готовая основа спрессовывается в вакууме с внутренней стороной внешнего визора
* Внешний визор имеет напыление для защиты от УФ, т.к. при затемнении всех окон может быть повреждена сетчатка без защиты УФ (надо тестировать)


== Modern tools ==
==Interface Animation==
1. [https://learn.microsoft.com/de-de/windows/mixed-reality/mrtk-unity/mrtk2/?view=mrtkunity-2022-05 MRTK-Unity] is a Microsoft-driven project that provides a set of components and features, used to accelerate cross-platform MR app development in Unity. Here are some of its functions:
* Provides the cross-platform input system and building blocks for spatial interactions and UI.
* Enables rapid prototyping via in-editor simulation that allows you to see changes immediately.
* Operates as an extensible framework that provides developers the ability to swap out core components.
* Supports a wide range of platforms.


2. [https://unity.com/products/unity-mars Unity Mars] helps solve the hard problems of AR app creation:
===Interface items motion===
* Overcome the challenges of authoring for dynamic physical environments
* Reduce development time
* Release cross-platform experiences with support for iOS, Android, and HoloLens


== Manuals ==
*common view
<nowiki>''Main article: [[Manual:1]]''</nowiki>
*active view when working with the menu
== Troubleshooting ==
*the process of selecting a menu item (scrolling elements, changing the view when entering the submenu)
*permanent (continuous) view (statuses, notifications, active menu items)
*turning on and changing fading windows (rules, combination options in a simultaneous form)


== Areas of research ==
==Modern tools==
== Related fields ==
#[https://www.qt.io/ Qt] + C++ ([https://doc.qt.io/qt-6/qtgui-module.html doc], [https://wiki.qt.io/Main wiki], [https://wiki.qt.io/Qt_for_Beginners quick start], [https://www.qt.io/product/features#js-6-3 framework modules], [https://rutracker.org/forum/viewtopic.php?t=6196654 6.2.4], [[wikipedia:QML#How-tos|QML]], [https://habr.com/ru/articles/331166/ Qt Habr], [https://www.qt.io/pricing/qt-for-small-business Qt for Startups], [https://choosealicense.com/ Open Source Licences], [https://www.qt.io/download-qt-installer-oss?hsCtaTracking=99d9dd4f-5681-48d2-b096-470725510d34%7C074ddad0-fdef-4e53-8aa8-5e8a876d6ab4 download for GNL3 Open Source])
== Future ideas  ==
#*SaaS (sale) delivery under [https://habr.com/ru/articles/243091/ GPLv3] or [https://www.gnu.org/licenses/lgpl-3.0.en.html LGPL3]+ tech support + updates
#[https://www.electronjs.org/ Electron.JS] + React.JS + TypeScript
#*
#[https://learn.microsoft.com/de-de/windows/mixed-reality/mrtk-unity/mrtk2/?view=mrtkunity-2022-05 MRTK-Unity] is a Microsoft-driven project that provides a set of components and features, used to accelerate cross-platform MR app development in Unity. Here are some of its functions:
#*Provides the cross-platform input system and building blocks for spatial interactions and UI.
#*Enables rapid prototyping via in-editor simulation that allows you to see changes immediately.
#*Operates as an extensible framework that provides developers the ability to swap out core components.
#*Supports a wide range of platforms.
#[https://unity.com/products/unity-mars Unity Mars] helps solve the hard problems of AR app creation:
#*Overcome the challenges of authoring for dynamic physical environments
#*Reduce development time
#*Release cross-platform experiences with support for iOS, Android, and HoloLens


* Описание: Action - Visual - Audial - Voice command - Gesture
==Manuals==
* Log In: ввод кодового слова (текст, голосом), далее выбор правильного ответа (2 попытки) из 8 вариантов 10, далее ввод второго кодового слова, далее выбор правильного ответа (2 попытки). При правильном вводе надпись "Welcome Username" При неактивности устройства в течение более 1 часа (настройки), повторная авторизация. Смена кодов задаётся администратором. При неавторизованном входе (неправильный ответ) надпись "Welcome" (без Username) - часть функций заблокирована (нет приёма сообщений, задач, данных; данные на устройстве "замораживаются" до правильной авторизации;), отправлено сообщение о несанкционированном входе, координаты позиции и др. данные передаются администратору с периодичностью 10 мин.
==Troubleshooting==
* Главное меню (неактивные элементы только надпись), наведение курсором (Hover effect, травление кнопки, параллепипед), клик (Hover effect out, рамка "прямоугольник", щелчок клика), после клика при наведенном курсоре снова Hover effect, при смещении курсора в сторону (остаётся рамка, активен/вкл.). Подменю то же самое. 4 состояния: курсор наведён (hover state), клик (click state), активен (selected), не активен (not selected).
* Курсор в форме стрелки с заливкой
* Главное меню показывается только при наведении курсора. Надписи без рамок. Анимировать, чтобы стало понятнее. [https://99designs.com/blog/design-resources/ui-design-tools/ Link1], Link2. Figma 3 files and unlimited coworkers.
* Окно не активно (уголки, длинный пунктир для границы окна). Окно активно (рамка). Долгий клик - свернуть окно в трей (не показывать). Двойной клик - развернуть на всю область. Снова двойной клик - минимизировать в первоначальный вид. Снова открыть свёрнутое окно через меню Виджеты и имя виджета. Сдвинуть окно стрелками (сначала по горизонтали, затем по вертикали) или перетаскиванием с зажатой кнопкой B (аналог правой клавиши мышки), или кнопкой прокрутки. Кнопка A (аналог левой клавиши мышки) для клика по элементам виджета. Двойной клик кнопкой B по виджету - открыть в том же окне соответствующее приложение с настройками. Снова двойной клик кнопкой B, открыть в том же окне соответствующий виджет.
* Режим управления дроном, и роботом, нижнее меню параметры дрона
* Нижнее меню: боезапас по видам
* Нижнее меню?: активные диалоги + канал (последнее сообщение), сам диалог в вертикальном диалоговом окне
Нижнее меню: задачи по приоритетам
*Иконки пользователей внутри окружности: звери, птицы, насекомые, пресмыкающиеся, музыкальные инструменты, грибы, герои фильмов и номер (для навигационной сетки)
*Анимацию интерфейса в Adobe AE
*Приложения: сканирование радиочастот (SCAN), радио (SDR), RDF, FA и др. - в поле Apps и Widgets
*На навигационной сетке свои (лазурные окружности и жёлтые треугольники) и чужие (красные круги-точки) без номеров, при команде индентификации появляются сноски с номером или позывным
*Разделители разделов меню - вместо наклонных линий - знак стрелки (ромба, угол наклона 30°). Скрываются неактивные элементы и линии. Показываются только при вызове.
*APPS, DVCS, WDGS, NETS, TSKS, CALR, WRGR, WIKI - на линии контура, внутри него иконки загруженных приложений для быстрого перехода
*Статусы вкл/выкл (tess status bar on / off / auto): TRM, HDL, SPK, CMP, + RDF, RDR, DTC, STS (иконка привидение) ... . Сверху двойное меню статусов (неподвижные элементы, всегда на своём месте) - снизу буквенное обозначение.
*Сверху меню статусов символьное: время, режим невидимости (нет излучения, только приём) / ограниченной видимости (маячок, передающий свою позицию, зашифрован, с разными интервалами передачи, на разных частотах, маскирующийся в диапазонах ТВ и др. невоенных диапазонах, КВ?) / видимости (маячок на VHF с шифрованием, ответ на запросы RDF), уровни принимаемых сигналов основных каналов, уровень заряда батареи, уровень яркости экрана, уровень звука в левом и правом наушнике
* Режим ограниченной видимости:
** Транспондер отвечает на запросы IFF через маршрутизатор внутри сети P2P с ближним радиусом покрытия.
** Радиообмен через маршрутизатор 1-2 членов группы (например, 1 антенна MOAN SAT), внутри цифровые пакеты через сеть P2P на базе Bluetooth или UHF с малой мощностью передачи с охватом только ближнего радиуса покрытия.
*Компасс компактнее и мелкие цифры на рисках
*Контур экрана взять с проекции фронтального вида маски (немного обрезать боковины)
*Поле в углу рядом с лупой для icon messages
*Использовать значки: квадрат, вертикальный прямоугольник, треугольник к низу / к верху / вправо / влево, окружность, ромб, трапеция, эллипс
*Выделения: сплошная линия, редкий пунктир, двойной пунктир, выделение по углам (уголки)
*Поля с затуханием. Слева: два сверху и два снизу (могут объединяться). Справа: два (может объединятья) справа и два по вертикали слева. Всего 10 окон с затуханием, разная комбинация. Возможно полное и частичное затухание. Частичное (50%) подходит для диалогового окна и для вывода сопроводительного текста
*Диалоговое окно справа. 50-60 символов, 2 строки с расширением. Пример поля мессенджера из LinkedIn.
**T.HARRIS 5:23pm > ME (TEAM NF332):
**||Thank you Basil, I will work on this information in the
**||next week. Sincerely and Semper Fidelis, David
**B.BOLUK 5:26pm > D.VOGT, L.HERRERA, +
**||In the next 2 weeks, we have intentions to apply to
**||xTechPrime, ONR Global-X Challenge 2023, Army...
*Поле диалогового окна выезжает справа одновременно с затуханием поля
*Области меню - динамически растягиваются и сужаются в зависимости от наполнения элементами
*Управление дроном. Правый управляется джойстиком, левый управляется наклоном головы, левая (правая) рука свободна. Плюс программные и физические кнопки на наушнике.
* Для каждой функции статус бара в таблице сделать краткое описание технических особенностей.
* Fire assist. Mountain mode. Включает более сложный баллистический расчёт, учитывающий эффект миража (для пустыни тоже), восходящие потоки, более крутую линию визирования (sightline hight), боковые потоки воздуха и др.
* Приложение Задачи (Календарь, Рабочие группы): список задач в окне Left Top B, при выборе задача открывается в этом же окне, чтобы не перекрывать окно левее с навигационной сеткой (если навигация не используется, тогда открывать в левом верхнем окне).
* Внешняя камера, в т.ч. дрон, робот и вид другого пользователя - в Left Bottom B, A, Right bottom A.
* Left Top A приоритеты: Nav Grid (в т.ч. совмещённый вид: IFF, Radar, RDF), Task, Workgroup
* Left Top B: вид фронтальной камеры наблюдения (когда центральное окно не используется или занято управлением дроном, роботом)
* Left Bottom A приоритеты: Rear Cam, Drone View, User View
* Left Bottom B: карта
* Central A / B, A+B: фронтальные камеры ( разделённый вид, совмещённый вид), Fire assist
* Right Top A: кратковременно (настройки приложений)
* Right Top B: SDR Scan, Radar
* Right Bottom A:
* Right Bottom B приоритеты: Messages, SDR, Radar
* Расписать приоритеты для приложений в окнах. Куда смещать при открытии более приоритетных приложений, при закрытии этих приложений. Возможно 4-5 приоритетов.
*Преобразование при передаче: голос - текст - голос. Можно читать или включить озвучание и слушать.
*Голосовой ассистент. Голосовые команды могут произноситься по-разному с разным акцентом, поэтому однозначные голосовые команды не эффективны (никто не станет заучивать наизусть десятки голосовых команд). Вместо этого используется голосовой ассистент на базе AI/ML. Создать отдельную страницу на эту тему. Поиск материалов "[[google:voice+control+assistant+open+source&oq=voice+control+assistant+open+source&aqs=chrome..69i57j33i160l3j33i22i29i30l5.45479j0j7&sourceid=chrome&ie=UTF-8|voice control assistant open source]]". [https://keenresearch.com/keenasr-use-cases-enterprise-apps.html?gad=1&gclid=CjwKCAjw9pGjBhB-EiwAa5jl3DS-5EPBqL5AFtfsvHI24JgtCM5-x6f3-0coxBIkYB22mjnqa4DpeRoCQhAQAvD_BwE KeenASR SDK]
*Поиск [https://www.allacronyms.com/hand-held_radio/abbreviated аббревиатур для UI]
*Ориентируемся на сенсоры SONY SWIR, которые включают видимый диапазон. Тогда LWIR в качестве 3-й камеры. Камера заднего вида тоже видимый свет + SWIR. При необходимости дополнительные сенсоры устанавливаются с помощью NVG mount.
*Кроме ночного видения SWIR mode подходит для дневного использования: сквозь туман, наблюдение за небом, объекты на поверхности воды, видимость людей в камуфляже и замаскированных объектов, мин-ловушек, пластиковых и металлических мин, технического осмотра.
*Кроме ночного видения LWIR mode подходит для дневного наблюдения за полем боя (горячие стволы, следы, массивные металлические замаскированные объекты, люди в камуфляже, особенно открытые участки кожи, при окружающей температуре ниже 26-29°C, особенно при благоприятной солнечной активности, которая формирует температурные контрасты.
*PRS (passive radar sensor). В окне отображается объект, излучающий или отражающий радиоволны в диапазоне 1kHz-5GHz. Пассивный означает, что для отражения мобильный облучатель установлен на безопасном расстоянии от пользователя. Позволяет видеть ЛА с включенным радаром, источники радиосвязи, в т.ч. носимые, РЛС и др. Для обнаружения мин-ловушек и металлических мин, др. металлических предметов в походных условиях может применяться облучатель в форме фонарика.
*GES (gamma ray emission sensor) устанавливается с помощью NVG mount. Позволяет обнаруживать опасные радиоактивные объекты, материалы и следы.
*Таким образом, почти полный спектр излучения попадает в видимую область и на навигационную сетку.
*AUF (audio filter). Позволяет не только вырезать некоторые полосы пропускания, но и более тонко динамически фильтровать паттерны. например, исключать шумы: пение птиц, звук ветра, шум воды, срабатывать за мс и ограничивать порог уровня при залпе (чтобы не глушить пользователя). Исключать эхо, т.е. переотраженные звуковые волны, чтобы выделять только первичный шум. И, наоборот, выделять и усиливать отдельные паттерны шумов: двигатели, треск ветвей деревьев, кашель, чихание, голос, металлический стук, трение камней, шаги, трение покрышек, лязг гусениц техники. Динамически закрывать отверстия в наушниках магнитным приводом. Встроенные в переднюю часть микрофоны с широким углом обзора и суперкардиодой позволяют точно обнаруживать источник шума. Возможно обработка на отдельной звуковой карте собственным процессором, в помощь огромные существующие коллекции шумов и звуков для ML (для обработки видео тоже отдельная видеокарта, особенно для Computer Vision, для ML тоже свой SOC соответственно, для SDR тоже свой SOC - всего около 5 SOC, которые интегрированы между собой)
*Виджеты. При нажатии на Виджеты справа в подменю все доступные, в т.ч. активные ранее использовавшиеся виджеты приложений. При нажатии на них они отображаются в том окне, как во время последнего использования. Их можно сдвинуть (нажать и удерживать при перемещении джойстиком / жестом руки, либо стрелками сбоку левого или правого поля; голосом: tess activ widget to left bottom B, либо имя виджета). Чтобы скрыть в трей (сделать неактивным), нажать и удерживать 2 сек. Чтобы открыть снова, выбрать Виджеты и выбрать виджет одним кликом.
*Виджет Healthcare. Показатели здоровья и жизнедеятельности организма.
*Приложения. Выбор приложения справа в подменю. Открытие в одном из окон, как виджет. При необходимости двойным кликом развернуть на всю левую или правую область. Использовать прокрутку как в сенсорном окне жестом или кнопкой прокрутки вниз и вверх. При долгом нажатии окно приложения скрывается в трее, но продолжает работать. Для принудительного закрытия приложения нажать на него в подменю и удерживать более 2 сек. Большинство приложений имеют виджеты для удобного отображения и оперативного использования. Настройки и ввод данных, импорт и пр. осуществляются в окне приложения. Из окна виджета можно открыть окно соответствующего приложения, если кликнуть по неактивной части виджета 3 раза.
*Уведомления, в т.ч. чатов показываются в подменю главного меню, в момент когда с ним не работает пользователь. В 2-3 строки с цитатой, 2 блока по горизонтали, листать стрелками вверх и вниз. При нажатии на уведомление открывается окно виджета. Например, чаты. Уведомления о задачах и автотрекере задач.
*Уведомления в подменю справа. Иконка. Дата и время. Текст. Галочка (+ ? крестик закрыть). Можно листать историю уведомдений, если окно активно.
*Входящее сообщения. Окно справа нижнее Б. Ник. Дата и время. Текст. Галочка (прочитать и свернуть). Ответить. Поделиться. Стрелка вправо (свернуть).
*Исходящее сообщение. Я. Дата и время. Цитата. Текст. Вложения (позиция, фото, видео, файл). Отправить. Отменить.
*Отправленное сообщение. Просмотрено кем и когда снизу. Листать стрелка вниз и вверх перемещает на полокна.
*Виджет Чаты. Включает разные комбинации: один-к-одному, многие-ко-многим. Настройки чатов находятся в приложении и в настройках каналов. Сюда добавляются каналы голосовой связи и текстовые сообщения. Сообщения голосовой связи перед отправкой переводятся в текст, отправляются в виде зашифрованного текстового сообщения, могут озвучиваться получателю. Есть метка, требуется ответ, будет висеть в уведомлениях, пока пользователь не ответит.
*Сообщения icon messaging system показываются сразу без уведомлений.
*Истории сообщений. Открыть виджет Чаты, справа выбрать соответствующий чат стрелками, жестами или голосом.
*Шрифты заглавными буквами. Курсивом в меню и подменю, обычным на меню значений и на виджетах, в окнах приложений.
*Навигационная сетка при увеличении на прозрачном фоне, при уменьшении на тёмном фоне.
*После завершения работы над этим разделом включить фрагменты а страницы с кейсами разных групп пользователей для обсуждения с менторами.
*Пусть не смущает обилие функциональности. Продолжительность работы над проектом не ограничена и мы планируем развивать продукт в зависимости от бюджета, нашей производительности, скорости развития технологий, ускоряющих работу, и наличия уже готовых решений и компонентов. Всё, что включено в описание технически уже реализуемо на существующем уровне развития техники.
*В качестве идеи. Затухающие окна с разным процентом затемнения могут работать как экраны против ослепляющего солнечного света.


==Storylines==
==Areas of research==
Расписать здесь, сделать включаемые вставки в роли. Ситуация. Описание ситуации, интерфейс, действия. Анимация.
==Related fields==
 
==Future ideas==
* Настройки камер и окон
* Настройки мультимедиа
* Работа с главным меню
* Использование системы свой-чужой https://en.wikipedia.org/wiki/Identification_friend_or_foe
** Транспондер с закодированным сигналом, передающий позицию, в режиме радиомаяка на частотах, маскируемых под FM и GSM. Прием запросов на одной частоте, передача на другой частоте, в т.ч. пакет содержит указание на частоту следующей передачи и новый ключ (?). https://en.wikipedia.org/wiki/Secondary_surveillance_radar
** Запрос после радиопеленга позволяет установить расстояние и в сообщении запроса указать предельную дальность распространения сигнала для ответа (мощность излучения)
** Ответ транспондера на частоте, с мощностью и протоколом, позволяющие ограничить дальность обнаружения маяка
** Пакетные ответы, где передачу осуществляет только один из группы, а между собой обмен через Bluetooth например.
** Ответы только в движении при смещении более 10-50 м. Неподвижные игнорируют, предполагается предыдущая отправленная позиция.
** Запросы с удалённого передатчика (?)
** Отраженный сигнал, принимаемый пассивным радаром
** В системах IFF обычно используются радиолокационные частоты, но могут использоваться и другие электромагнитные частоты, радио или инфракрасные.
** Пакет сообщения транспондера может включать не только позицию, но данные датчиков жизнедеятельности, запас боеприпасов, технические неисправности устройства.
** Сервер анализирует регулярность и полноту информации обо всех пользователях.
* Использование режима невидимости
** Режимы радиомолчания (при неподвижной позиции запросы IFF игнорируются, отвечать только тем, кто вблизи)
* Ориентирование и навигация (компас, сетка, идентификация)
* Текстовые сообщения
* Голосовые сообщения
* Символьные сообщения
* Обнаружение низколетящих ЛА с включенным радаром
** 8-12 GHz, 12-18, 24-40 и др. https://en.wikipedia.org/wiki/Radar
** Пассивный радар, использующий эффект освещения цели другими источниками радиосигналов, излучаемых в т.ч. всесторонними антеннами УКВ, УВЧ диапазонов - FM радиостанций, базовые станции мобильной связи
https://en.wikipedia.org/wiki/Passive_radar
* Обнаружение дронов (SWIR,
* Обнаружение в горах
* Обнаружение на водной поверхности
* Обнаружение источников радиосигнала
** Определение направления к источнику подозрительного радиосигнала (связь, радар, источник радиопомех, радиомаяк) и характеристик сигнала
** Определение позиции подозрительного источника сигнала, излучаемого всенаправленной антенной в пределах радиогоризонта (light-of-sight), с помощью RDF (метод триангуляции, радиопеленг), (тактовая частота устройств синхронизирована)
** Определение скорости движения излучающего или отражённого радиосигнала (эффект Допплера, CW радар непрерывного действия) и отслеживание его азимута
* Прицельный огонь по дронам
* Прицельный огонь по наземным целям
* Управление дроном
** Вместо левого джойстика - управление наклонами головы или управление виртуальными джойстиками с помощью жестов. Например, аппаратный джойстик на наушнике справа, а правая рука занята, тогда левой рукой жестами управление правым виртуальным джойстиком, а головой - левым виртуальным джойстиком.
** Возможность не использовать джойстик (обе руки свободны), управление только наклоном головы (вперёд, назад, влево, вправо) и голосом (поворот, вверх, вниз, зависнуть, следовать, кружиться над целью, кружиться по дуге с радиусом, управление высотой).
** Обработка видеосигнала с помощью Computer Vision. Дрон передает потоковое видео, GPU устройства с включенной функцией "OD" распознает и помечает объекты.
** Пресет "кружится над целью". Оператор указывает распознанный объект и выбирает команду "кружится над целью" и параметры (радиус, полный круг или сегмент круга, высоту - авто / диапазон / точная высота). Если цель движется, дрон следует за целью. Избегание препятствий (?). Передача координат цели. Уточнение координат (относительные координаты) при нарушении GNSS с помощью RDF с двух или более устройств.
* Управление роботом
** Возможность не использовать джойстик, управление только наклоном головы и голосом.
* SIGINT
* IMINT


==Further reading==
==Further reading==
==See also==
==See also==
{{See Also ARHUDFM}}
{{See Also ARHUDFM}}
==See also product details==
{{See Also Product Details}}


==References==
==References==
<references />
==External links==
==External links==
[[Category:ARHUDFM]]
[[Category:ARHUDFM]]
Line 2,306: Line 1,688:
[[Category:Problem-Solution Fit]]
[[Category:Problem-Solution Fit]]
[[Category:Software Engineering]]
[[Category:Software Engineering]]
[[Category:Artificial Intelligence]]

Latest revision as of 19:41, 18 August 2024

Abstract

redirect Further information: Public:ARHUDFM Manifesto, Public:Applications, Public:ARHUDFM Features Summary, Public:DoD_Pains

Augmented Reality Heald-Up Display Fullface Mask (ARHUDFM) is a complex device that is not easy to understand at a first look, because there are little relevant examples to compare. Therefore, we suggest that you first read the information on the Public:ARHUDFM Manifesto page at the link above.

This page describes the structure and contents of the GUI (Graphical User Interface) used in the ARHUDFM device.

For a brief description of the functions of each application, please see the Public:Applications page.

Click on the picture to zoom in

Interface description

Appearance

Left Center Right
LMMP Left main menu fading pads SBP Status bar fading pads RSBP Right submenu fading pads
LQMP Left quick menu fading pads CLW Central left window RQMP Right quick menu fading pads
LFSP Left features sidebar fading pads CRW Central right window RFSP Right features sidebar fading pads
LUW Left Upper window CWJP Central window joystick pads RUW Right Upper window
LTAW Left Top A window CWBP Central window buttons pads RTAW Right Top A window
LTBW Left Top B window RTBW Right Top B window
LBAW Left Bottom A window RBAW Right Bottom A window
LBBW Left Bottom B window RBBW Right Bottom B window

Features

The interface is designed for the screen of the ARHUDFM device with FOV 105°h (stereo overlap) and 33°v, has a resolution of 3840px in width and 1200 px in hight.

Normal human stereoscopic binocular vision is 180° horizontally, up 55°, down 60°.[1] If the area of ​​peripheral vision important for situational awareness is excluded, a comfortable field of view, especially if a person wears optic corrective glasses, will be 105-115° horizontally, 20° up and 25° down. Since the airway obturator of the mask from below is an obstacle to vision, the field of view of a person wearing a mask from below is less than usual (however, pilots of combat aircraft have sufficient visibility). Horizontally, the mask user has a complete view of the entire field of view, including the peripheral part, which is important.

The visible field is projected by the LED beams of a DLP projector offering high contrast and better color reproduction with high response.

Unlike the harmful effects of the blue light spectrum (light colors contain a lot of blue) emitted by the LED screen of a monitor or mobile device, which causes fatigue, headaches and sleep problems when exposed for a long time, the reflected light of a DLP projector (and other types of projectors also) does not have such disadvantages. In addition, in the ARHUDFM device, the principle of displaying the interface resembles the night mode (dark background, light graphic symbols). These conditions for the user create the possibility of round-the-clock work without stress.

The constant optical focus is set to an apparent distance of 1900 mm (75 in) from the user's eyes, which prevents conflict of vergence and accommodation so that the user's eyes do not get tired during long-term use. No virtual visual objects have a different image depth, just as if the user were to observe the display screen at a distance of 1900 mm while observing the rest of the environment with the focus oriented to infinity. This statement is based on numerous studies and experiments of different laboratories with a large number of respondents.

The tension of the muscles of the eye due to the close distance to the object in question causes fatigue, including being one of the causes of the development of myopia. Neck muscle tension and stoop due to the need to focus on a fixed part of field of view for a long time is also an unfavorable factor. This applies to all cases of human work with the screens of laptops, mobile devices, reading paper books and documents.

To imagine the actual visible edges (not the focal length) of the screen, sit in front of a 65" or 1440mm (57.3 inches x 32.9 inches) TV screen at a distance of 22" or 550mm from your eyes. You can clearly see the right and left sides of the screen by turning your eyes. You don't need to use the peripheral part of the vision at the edges, it remains completely open due to the wide field of view of the device's visor. Only in the lower part, when using the airway obturator of the device, the field of view of the user is limited to about 20°, as is the case with any respirator or when wearing most models of glasses. Glasses tend to shrink the effective field of view to somewhere between 90 and 115 degrees horizontally and 35-45 degrees vertically, depending on the width and hight of the glasses and their proximity to the eyes.

We've added these comments because most people don't have experience with these kinds of AR devices yet. Microsoft IVAS [2](Hololens 2) uses holographic optics, thick lenses and FOV 43°h 28°v, Magic Leap has similar technology to Microsoft and FOV 45°h 55°v. Apple Vision Pro is a VR device (opaque LED display) like the Meta (Oculus) Quest - FOV 90°h 98°v[3], HTC Vive, SONY Playstation, etc. None of these technologies or devices are like ARHUDFM and when used in tactical tasks carry many significant risks. More about it here.

The main feature of Augmented Reality devices is that a person can only see lighter areas on a darker screen background. The nature of vision is that a person sees not objects, but the light reflected from them. Those, can see a high-contrast image in a darkened room (Microsoft uses a tinted visor) or at night, but see almost nothing against a bright sky, on a sunny day, with strong reflections from snow or building walls, when looking at the sun. A person will not be able to see dark areas on a light background in principle, since this contradicts the physics of light (dark areas are the absence of light). The ARHUDFM solves this problem by using "smart windows" - the interface contains 10 large and 56 small fading pads that instantly change their transparency from 0% (opaque black) to 100% (fully transparent) depending on the ambient light or the mode selected by the user.

Principles

Since the user interface of the ARHUDFM device has more functions than is usually used by users of computers and mobile devices, and the device is such that it can be used for a long time in tactical conditions, the following principles are observed:

  1. As small screen area as possible should obstruct the view of the actual visual environment at all times
  2. The user must maintain the minimum necessary view of the visual environment for orientation in space
  3. If any element of the interface is not directly needed by the user at the moment, it should not be displayed on the screen
  4. The user should be able to change the interface configuration very quickly
  5. The user must be able to simultaneously clearly distinguish between interface elements and the visual environment at any brightness.
  6. Interface elements must not be visible from the outside of the device or create light emission to the outside
  7. The user's face must not be illuminated by reflected radiation, must not be visible from the outside at the night
  8. The audio environment should not have an attenuation greater than 10 dB SPL, except when using the noise reduction features

Interface controls

ARHUDFM multimedia location

Right hand hardware controls

  • Joystick. Cursor movement, drone and robot control
  • Device on/off button
  • Headphone mode control button (see Status bar)
  • Button "- >". Decrease, right arrow, PgDown.
  • Button "< +". Increase, left arrow, PgUp.
  • Button C. Click, left control button
  • Button D. Context menu, Shift, right control button

Left hand hardware controls

  • Headlamp (Spotlight) on / off button
  • Headset connector for handheld portable / manpack radio (also ground / vehicular radio headset cable)
  • Loudspeaker on / off and control button
  • Button "< -". Decrease, left arrow, PgDown
  • Button "+ >". Increase, right arrow, PgUp
  • Button A. Click, left control button, headset PTT button for radio
  • Button B. Context menu, Shift, right control button, Photo, other assigned functions
  • Buttons A+B simultaneously start / stop video record

Software controls

  • Voice assistant
    • Machine learning (AI) algorithms are used to recognize the meaning of user commands, not necessarily the exact pronunciation of the voice command, including the ability to adapt to the voice and pronunciation of the user
  • Gesture control
    • The stereo camera captures the image of the hands and recognizes the user's gestures (more details on the Hand Tracking page)
    • Gesture library constantly updated, Machine Learning allows the user to create custom gestures
    • Gestures can indicate not only the state, but also the dynamics, for example, smoothly change the volume level, brightness, etc.
    • Capturing and recognizing fingers allows to use software interface controls, including scrollbars, buttons (and a virtual keyboard if necessary), swipe sideways and up or down, scale and rotate screens inside a window, hide and move windows

Perception hardware

The advantage of this wearable and inexpensive device for tactical use by almost every military person is the ability to perceive light, sound and radio waves, inaccessible to humans.

Cameras

  • Image capture with a three-sensor front stereo camera. One objective lens transmits the image to the separation prisms and then to 3 sensors: DSLR IR-cut 4K/8K/12K UHD, SenSWIR, HDR
  • Separate camera in the range of LWIR (thermal image vision)
  • Separate rear view camera with extended visible light and SWIR
  • Folded optical lenses design
  • Built-in Speed ​​Booster reduces focal length and increases aperture for individual sensors
  • Built-in teleconverter, on the contrary, increases the focal length for other sensors, increasing the image of distant objects
  • IR filter laser protection lens coating for 700-1080 nm (against systems for remote detection of optical and optoelectronic devices)
  • Infrared and laser light sources are not used in this device, because this demasks the user


Microphones

  • Built-in MEMS (Micro-Electro-Mechanical-Systems) microphone (1) in mask obturator airway to transmit the user's voice
    • If the lower part of the mask is not used, a boom microphone (2) with a windproof pad on the flexible goosneck is connected
  • 19 external MEMS cardioid microphones, "flat/dome" acoustic arrays allow to perceive sound waves in a wide range of frequencies, including those inaudible to humans, from very low to very high, used in Computer Audition modes (CAC)
  • The super-cardioiod and ultra-cardioid microphones with a narrow directivity pattern on the front of the mask allow to accurately determine the source of the sound wave
  • 2 insulating layers, airway obturator and seal around face make the user's voice almost inaudible from the outside

Radio antennas

  • Built-in transmit-receive antennas in the ranges of the near radius of communications (Bluetooth, Wi-Fi, LTE, 5G)
  • Integrated manpack antennas for communications in the VHF, UHF, UHF SAT, MUOS, L/S bands
  • Integrated manpack antennas for analyzing and listening to the frequency ranges 2 MHz - 8 GHz
  • Not every user needs a separate antenna or a set of several antennas with different characteristics, using the P2P network within the group, packets of messages and received data can be exchanged and routed
  • Integrated passive radar antenna with active phased array (installed in NVG mount)
  • Integrated handheld portable short-range active metal re-radiation radar antenna
  • Integrated receiving antenna for radar warning system
  • Integrated antenna for remote control of a drone or robot
  • Integrated antenna for close-range remote control of an active phased array radar (portable or vehicle-mounted)
  • Software-defined (reconfigurable) antenna (installed in NVG mount and the other two via the picatinny rails on the sides of the helmet)
  • The software-defined antenna is capable of combining the functions of most integrated antennas


The specific is that when using a separate optical lens for each sensor on the left and right, there is a problem of parasitic multi-angle, which will have to be constantly leveled by software, which affects the accuracy of binocular stereo vision. If in a smartphone this is not critical, and there may be 4-8 cameras with their own optics, then for tactical tasks this is of great difficulty. In this case, on the left and right, it is necessary to accurately hold the horizontal distance between the lines of sight for each pair of sensors and position them vertically, and then programmatically compensate for the vertical shift in order to reproduce a single optical axis for the left and right channels. In addition, the design of the device should allow this to be done without difficulty, including taking into account the angle of the field of view of the optics and solving the problem of shadowing.

Menu items description

redirect Further information: Public:Applications, Public:Voice User Interface

The menu has 7 functional sections:

  • Status bar (SB)
  • Left main menu (LMM)
  • Right submenu (RSB)
  • Left quick menu (LQM)
  • Right quick menu (RQM)
  • Left features sidebar (LFS)
  • Right features sidebar (RFS)

The principle of managing menu items of some sections is the same, and some are different.

Status bar (SB)

The status bar is located in the top middle of the visible area and contains all the main and frequently used information about the use of device functions and applications.

A total of 12 items for quick selection and tracking are available in the status bar, each of which contains sub-elements responsible for specific function presets. Preset settings are carried out not through the status bar, but in the settings of services or applications. The status bar is always displayed and is not hidden. Each element is located in a separate field (fading pad).






The sub-elements of the status bar are controlled by clicking (joystick, gesture control) or by voice (the result corresponds to the click). Default states:

  • Hover state: 4 corner segments of the field frame (in the above example in the "Radio Detection modes" field with the "IFF" function)
  • Click state: frame on the border of the field (animation effect, twice 100 ms), with each click sequenced display of list elements (presets)
  • Selected (long click >2 s): vertically positioned rectangle in the lower left corner
  • Not selected (long click >2 s): no vertical rectangle in the lower left corner

Differences in voice control:

  • The command to the voice assistant contains a description of the desired action and state, so it is faster
  • The voice assistant understands different interpretations of actions and states, so there is no need to memorize voice commands

SB indication and change of display

Indication Designation Field Change of display / Short description
Time / Date 1.
  • Selected / Not selected: not applicable
Battery 1.
  • Not selected: Battery Saver (BSVE) disabled - displays levels 40-60-80-100% - azure color
  • Selected: BSVE enabled - <40% - yellow color, <10% - red color
Water 1.
  • Not selected: Water Saver (WSVE) disabled - displays levels (12 bars) >5/12 - azure color
  • Selected: WSVE enabled - <5/12 - yellow color, <2/12 - red color
Spotlight 1.
  • Not selected: disabled - displays the intensity level of the last use (5 divs: 20-40-60-80-100%) - azure color
  • Selected: enabled - displays the current intensity level - yellow color
    • in flickering mode - displayed with flickering
    • in strobe mode - red
Brightness modes 2. States are the default. Selecting a mode changes the brightness and fading of the fields (fading pads and all windows at the same time, it acts as sunglasses). For some apps, the app window fading settings are adjusted individually in the app for greater contrast, these settings take priority over the default settings
Windows modes 3. States are the default. The user can quickly and flexibly manage the window configuration for each window individually, see below Windows items description
Camera modes 4. States are the default. Depending on weather conditions and time of day, indoor or outdoor user activity, a quick preset selection is needed for effective surveillance, detection, and task execution
Audio modes 5. States are the default. Allows the user to quickly turn the loudspeaker on or off (as well as the buttons on the left headphones ear cup). Adjust the loudspeaker volume and monitor its status

Also allows to quickly adjust the mode and volume of the headphones (as well as the buttons on the right headphones ear cup). At least one mode and one headphone volume level are always on

Computer Vision modes 6. States are the default. Presets are available to the user for quick selection depending on tactical tasks. Presets can be turned on several at the same time and separately, which makes it possible to optimize the used computing resources and power consumption
Computer Audition modes 7. States are the default. A person hears sound as several frequencies (frequency carriers) at the same time and different frequencies at different volume levels. Presets are available to the user for quick selection depending on tactical tasks. Presets can be turned on several at the same time and separately, which makes it possible to optimize the used computing resources and power consumption
Radio Detection modes 8. States are the default. Any mission is associated with the tasks of SIGINT, identification of friend or foe, detection of drones and robots, anti-personnel and anti-tank mines, trip wires, IEDs, and counter-radar protection for each military person without exception. Presets are available to the user for quick selection depending on tactical tasks. Presets can be turned on several at the same time
Firing Assistance modes 9. States are the default. This mode helps to conduct accurately aimed fire using all types of sights: Red Dot, telescopic sight, and digital sight and is also compatible integration with the remote control of the robotic turret
Stealth modes 10. States are the default. This mode is necessary to limit visibility by means of enemy SIGINT
Vitals Body Tracking modes 11. Vitals Body Sensors Control (VBS)
Networks modes 12. Networks (NET)

SB Presets

Indication Field name Preset Preset name Actions
Time / Date, Battery, Water, Spotlights modes na Time / Date
  • each click alternates the display of the current time and date, nothing else
na Battery
  • each click, the display of the indication of the battery and the water supply of the drinking system alternates
  • in the Selected state, launches the Battery Saver (BSVE) application, which allows to optimize power consumption
  • at <40%, the BSVE application starts automatically, at <10%, only the minimum necessary functions and applications function
na Water
  • each click, the display of the indication of the battery and the water supply of the drinking system alternates
  • when in the Selected state, launches the Water Saver (WSVE) application, which allows to hydrate on a schedule (text and voice user notifications)
  • at level <5/12, the WSVE application starts automatically, at <2/12 the hydration mode changes (interval increases, monitoring of vital signs indicators is turned on, a message is sent to the cloud system)
na Spotlight
  • alternative to a long click - a long press of the button on the left headphones ear cup turns on, and when you click again, turns off the flashlight
  • when click (or +/- button on the left headphones ear cup simultaneously with the flashlight control button) switches the light intensity (5 options)
  • when simultaneously pressing the B button (on the left headphones ear cup) + the flashlight control button (on the left headphones ear cup) with one hand, it turns on the flickering mode (SOS)
  • when simultaneously pressing with both hands the D button (on the right headphones ear cup) + the flashlight control button (on the left headphones ear cup) turns on the strobe mode
  • after turning off, when turned on again, it turns on the constant light mode and the intensity of the last use
  • when the full invisibility mode is on, the user will not be able to turn on the flashlight
  • in battery saving mode, the intensity will be reduced automatically or automatic shutdown will occur
  • fine adjustments are made in the LED Spotlight settings (SPOT) app
Brightness modes

OR condition when selecting presets (selecting one preset cancels the selection of the previously selected preset)

AUTO Auto
  • the light sensor detects the ambient light level and uses the settings of one of the following modes
  • fading windows 100% in all full-color projections
CLR Clear day fading pads 50%, fading windows 50%, projector beam 100%
CLD Cloudy fading pads 25%, fading windows 25%, projector beam 75%
TWL Twilight fading pads 0%, fading windows 0%, projector beam 75%
DRK Dark night fading pads 0%, fading windows 0%, projector beam 50%
NLTS Night lights fading pads 50%, fading windows 25%, projector beam 75%
DZLD Dazzling day fading pads 75%, fading windows 75%, projector beam 100%
Windows modes

AND / OR condition when selecting presets (selecting one preset in one case cancels, and in the other case does not cancel the selection of the previously selected preset)

DFLT Default displays all active windows according to the configured application and feature priorities; DFLT - deselects any previously selected preset
OFF Turn off all windows turns off the display of all windows; OFF - deselects any previously selected preset
CLW Central left window is On, central right window is Off if both central windows (left and right) were used by default, disables the central right window, all functions remain available in the central left window; CLW cancels CRW and vice versa
CRW Central right window is On, central left window is Off as in the previous case, on the contrary, disables the central left window, improving the view of the environment; CRW cancels CLW and vice versa
BWON Bottom windows only turns off the upper windows (except LUW and RUW) on the left and right to improve the view ("knight's narrow visor effect"), transfers higher priority windows to the lower area, closes lower priority windows, does not turn off the central windows; BWON cancels LWON and RWON
LWON Left windows only turns off all windows on the right (except RUW) ("left eye effect"), transfers higher priority windows to the left area, closes lower priority windows, does not turn off central windows; LWON cancels RWON and BWON
RWON Right windows only turns off all windows on the left (except LUW) ("right eye effect"), transfers higher priority windows to the right area, closes lower priority windows, does not turn off central windows; RWON cancels LWON and BWON
Cameras modes

AND / OR condition when selecting presets (selecting one preset in one case cancels, and in the other case does not cancel the selection of the previously selected preset)

FHD Frontal HD cam uses visible light range (400-780 nm) and dual sensor capabilities, high resolution and wide dynamic range under strong contrast lighting
RHD Rear HD cam turn the rear view camera on and off
SWIR Night / Sky / Fog / Sea vision mode uses a wider short-wavelength infrared light range (780-1700 nm), which is used to observe the reflection of ambient light in this range by objects located on the surface of the water, in fog, in smoke, in clouds, at dusk and at night
LWIR Thermal image vision mode uses long-wavelength invisible infrared light (7.5-14 µm) emitted by objects warmer in relation to the environment, mainly at night
SLV Silhouette vision mode turns on the transformation of the fill into a color outline mode that is well distinguishable in relation to the background for contrasting objects
MXV1 Mixed vision mode Type 1: FHD + SWIR allows to use the capabilities of three different sensors in different conditions day and night; 4K UHD + HDR + SWIR
MXV2 MXV Type 2: SWIR + LWIR allows to use the capabilities of two different sensors in different conditions day and night; SWIR + LWIR
MXV3 MXV Type 3: FHD + SWIR + LWIR allows to use the capabilities of four different sensors in different conditions day and night; 4K UHD + HDR + SWIR + LWIR
MXV4 MXV Type 4: FHD + SWIR + LWIR (silhouette mode) allows to use the capabilities of four different sensors in different conditions day and night; 4K UHD + HDR + SWIR + LWIR (silhouette mode)
Audio modes

AND / OR condition when selecting presets (selecting one preset in one case cancels, and in the other case does not cancel the selection of the previously selected preset)

LSPK Loudspeaker On/Off
  • alternative to a long click - a long press of the Loudspeaker control button on the left headphones ear cup turns on, and when you long click again, turns off the loudspeaker
  • the volume is changed with one hand with the +/- buttons on the left headphones ear cup at the same time as the loudspeaker power button (when it is turned on)
  • after turning off when turning on again sets the volume of the last use
  • in full stealth mode, the user will not be able to turn on the loudspeaker
L Left On, right Off
  • alternative to a long click - a long press of the Headphones control button on the right headphones ear cup switches only between L, R, LR modes; L cancels R, LR
  • the soundproof flap in the left headphones ear cup is closed
  • the volume is changed by selecting presets 25, 50, 75, 100 or using the +/- buttons on the right headphones ear cup
  • after switching when selected again sets the volume of the last use
R Right On, left Off
  • see above; R overrides L, LR
  • the soundproof flap in the right headphones ear cup is closed
LR Left On, right On
  • see above; LR cancels L, R
  • the soundproof flaps in both headphones ear cups are open
25 25% sound level changes the headphone volume; 25 cancels 50, 75, 100
50 50% sound level changes the headphone volume; 50 cancels 25, 75, 100
75 75% sound level changes the headphone volume; 75 cancels 25, 50, 100
100 100% sound level changes the headphone volume; 100 cancels 25, 50, 75
Computer Vision[4][5] modes

AND condition when selecting presets (selecting one preset in one case does not cancel the selection of a previously selected preset)

OD Object detection
  • OD based on a trained neural network allows to detect people, equipment, drones, artificial structures from different angles and at different distances, highlighting them on the screen, measuring distance, azimuth, elevation, height above the ground, speed, course destination and geolocation, as well as displaying them on the navigation grid
  • launches the CVC app in the CRW window by default at the same time as the last used front camera preset (FHD, SWIR, LWIR, SLV, MXV1-4)
  • if necessary, prompts the user to select another front camera preset, as well as launch Computer Audition and Radio Detection presets to refine detection results
  • uses local pattern library only
  • can be run simultaneously with MD, FD, FR, OCR, HSTD presets
MD Motion detection
  • MD helps to detect moving objects, people and evehicles ignoring the flights of birds and insects, tand he movement of clouds. MD mode is recommended to be used in conjunction with Radio Frequency Drone Detection (RFDD) and Computer Audition Detect noises of aircraft motor (DAM) preset
  • uses local pattern library only
  • can be run simultaneously with OD, FD, FR, OCR, HSTD presets
FD Facial detection
  • FD incl. using LWIR camera sensor and trained neural network helps to detect people's faces
  • uses local pattern library only
  • can be run simultaneously with OD, MD, FR, OCR, HSTD presets
FR Facial recognition
  • FR using a neural network in the presence of an exchange with the server allows to recognize people's faces for identification (part of the database can be stored on a local drive)
  • always executed at the same time as the FD preset
  • can be run simultaneously with OD, MD, OCR, HSTD presets
OCR Optical character recognition
  • OCR allows to recognize text and other graphic characters for subsequent translation and documentation
  • uses local pattern library only
  • can be run simultaneously with presets OD, MD, FD, HSTD
HSTD Heat and smoke trace detection
  • HSTD helps detect aircraft and missile trajectories, artillery and mortar fire from closed masked positions
  • uses local pattern library only
  • can be run simultaneously with presets OD, MD, FD, FR
Computer Audition modes

AND condition when selecting presets (selecting one preset in one case does not cancel the selection of a previously selected preset)

DAM Detect noises of aircraft motor
  • DAM, unlike DHUM, works only with patterns of aerodynamic, electromechanical and mechanical noise, using a trained neural network, isolating and amplifying sounds and noises that are most likely associated with the operation of drones, helicopters, turboprops and jet aircraft
  • this preset allows to focus on likely threats from the air and determine the direction of the source of sound waves
  • DAM is recommended to be used in conjunction with Radio Frequency Drone Detection (RFDD) and Computer Vision Motion Detect (MD)
  • uses local pattern library only
  • can be played simultaneously with ENAT, ECHO, DHUM, STHR presets
ENAT Exclude sounds of nature
  • ENAT sequentially selects the sounds and noises of nature (wind, rustle of leaves, birdsong, water sound, etc.) in several frequency ranges with the help of filters, then using a trained neural network to select patterns for final filtering
  • this preset allows to focus on the sounds and noises associated with human activity
  • uses local pattern library only
  • can be played simultaneously with presets DAM, ECHO, DHUM, STHR
ECHO Eliminate echo
  • ECHO, using built-in algorithms, allows to detect primary and reflected sound waves in order to correct the direction of the source of sound waves when other presets are working
  • prompts the user when to enable this preset if one of the other presets is already enabled
  • uses local pattern library only
  • can be played simultaneously with DAM, ENAT, DHUM, STHR presets
DHUM Detect noises of human activity
  • unlike ENAT, DHUM works in the opposite direction, using a trained neural network, to isolate and amplify sounds and noises that are most likely associated with human activity (tire friction, footstep sounds, stone friction, radio speaker sound, engine sounds, electromechanical noise, coughing, sneezing, speech, etc.)
  • this preset highlights these patterns of audio frequencies, amplifies them, while attenuating the sound level of the environment
  • this preset allows to focus on the sounds and noises associated with human activities, and determine the direction of the source of sound waves
  • this preset also uses the method of acoustic location and determining the coordinates of the enemy battery based on the sound of firing its guns (or mortars, or rockets)[6]
  • uses local pattern library only
  • can be played simultaneously with DAM, ENAT, ECHO, STHR presets
STHR Limit sound threshold
  • STHR assists the user in variable high ambient sound pressure conditions by dynamically reducing the maximum level by ∆ 80 dB SPL to 15-85 dB SPL
  • STHR is synchronized with the electromechanical sound dampers in the headphone design
  • can be played simultaneously with DAM, ENAT, ECHO, DHUM preset
GFL Gunfire Locator is a system that detects and conveys the location of gunfire or other weapon fire using acoustic[2], vibration, optical[3], or potentially other types of sensors, as well as a combination of such sensors. These systems are used by law enforcement, security, military, government offices, schools and businesses to identify the source and, in some cases, the direction of gunfire and/or the type of weapon fired.
Radio detection modes

AND condition when selecting presets (selecting one preset in one case does not cancel the selection of a previously selected preset)

IFF Identification Friend-or-Foe
  • IFF uses a transponder (transmitter-responder) Identification Friend-or-foe system, which in response to an encrypted interrogation signal received on one frequency, sends an encrypted message packet on another frequency containing the confirmation "Friend", Id, callsign and position
  • when used simultaneously with one of the "Stealth" modes presets, IFF will send a response message at different frequencies, in different networks, and with different power (for a limited distance) or will not send a message at all
  • a transponder with a specified interval at certain frequencies periodically generates and sends interrogation signals to an indefinite circle of people for registration and display on the navigation grid of one of the screens of user positions, with confirmation "Friend"
  • interrogation signals sent via an omnidirectional antenna or a directional antenna (the omnidirectional pattern can be limited by a reflective array or a software-defined antenna can be used)
RDF Radio Direction Finding[7]
  • RDF applies the radio direction finding of received radio frequencies that are identified as potentially threatening (radar, EW&SIGINT, ECM systems) or identified as the source of an RF carrier (analog or digital signal) for communication
  • using triangulation in collaboration with a similar device of another user in the P2P network (at a short distance with it) determines the direction and distance to the radio signal source
  • without the help of another user's device or software-defined antenna determines only the direction (course) to the radio signal source
  • commonly used after running the SDR Scan (SDRS) app to first identify the characteristics of the radio signal and not unmask itself unnecessarily
  • in accordance with the current rules and restrictions, the mission can initiate a task for the above IFF app if the interrogation signal is not sent to identify the source of the signal by other methods or with the help of other persons
  • in conditions of distortion or jamming of radio signals of navigation satellite systems, it is used for radio navigation using terrestrial radio beacons operating in other frequency bands, including FM, TV and mobile radio broadcasting bands
RFDD Radio Frequency Drone Detection[8]
  • RFDD enables the mode of radio frequency detector used to detect the presence of RF waves in physical transmission mediums
  • the system uses these RF Detectors to detect drones and drone pilots (land, waterborne and aerial drones)
  • RFDD also uses AI to identify the type of threat by comparing different frequency patterns
  • the system can easily distinguish drones from common RF signals by using learned patterns and can identify almost all types of threats as well as the location of the drone pilot
  • can use a compact omnidirectional mobile manpack antenna, a directional software-defined antenna, or a longer-range mobile portable antenna
  • has a range of 9 kHz - 8 GHz and a detection distance of up to 3 miles (conical or dome range)
  • this function displays on the navigation grid and / or on the map of the terrain of the interface screens the positions of the identified RPA (UAV) and its operator
  • RFDD mode - a special case of the RDF function, it is recommended to use it in conjunction with the Computer Vision Motion detection (MD) and Computer Audition Detect noises of aircraft motor (DAM) modes
EODD Radio Frequency Explosive Ordnance Disposal Detection
  • EODD - uses an external handheld Metall Re-radiation Radar (MET3R) device, via a Bluetooth or Wi-Fi Direct connection
RWR Radar Warning Receiver[9]
  • RWR - turns on the mode of detecting exposure from air defense radars and counter-battery radar[10], displays on the screen in a window with a navigation grid and/or a map the geolocation of these radars
  • RWR mode is indispensable when performing tactical tasks of mortar and artillery fire
Firing assistance modes

OR condition when selecting presets (selecting one preset cancels the selection of the previously selected preset)

GF Fire on ground fixed targets
  • captures and tracks up to 10 targets simultaneously
  • for each target calculates the ballistic trajectory at a distance based on 20 parameters
  • displays 16 ballistic calculation reference data (display can be turned off)
  • the user sees in the interface and can make manual changes (input field) to the parameters of the ballistic calculation
  • displays the aiming point taking into account corrections on the reticle relative to the crosshair with a scale in the form of digital data (Eunit and Wunit) MOA/MIL (true minute of angle/milliradian)
  • separately displays the numerical values ​​of the corrections: Elevation and Windage when using Red Dot Sights or Holographic Sights (both eyes open), the user visually compares the position of the aiming dot and corrections relative to the crosshair on the screen (point of impact) and the contour of the target - with the contour in the sight window and the sight dot (usually 2-5 MOA), such shifting the sight dot (line of sight) in a way to hit the target at the crosshair point as on the screen of the device
  • when integrated with a digital sight, it immediately displays on the screen in the form of a diamond the sighting line of the digital sight, which must be aligned with the displayed aiming point
  • evaluates the inaccuracies of the ballistic calculation in case of a miss and offers the user corrections (takes into account aiming inaccuracies only for a digital sight)
GM Fire on ground moving targets
  • additionally calculates the angular velocity for the uniform movement of the target, the measurement of the distance to the target, the course of the target and indicates corrective lead corrections
AM Fire on aerial moving targets
  • additionally calculates the angular velocity, change in azimuth and elevation, determines the nearest probable trajectory with the designation of corrective lead corrections
MF Mountain fire on fixed targets (prospective function)
  • additionally takes into account more complex parameters for calculating a ballistic trajectory in mountainous and desert areas based on an assessment of the landscape, temperatures, an assessment of ascending air currents and the mirage effect, shot history
MM Mountain fire on moving targets (prospective function)
  • as above plus additionally calculates angular velocity and denotes lead corrections
Stealth modes

OR condition when selecting presets (selecting one preset cancels the selection of the previously selected preset)

IFF IFF visible only
  • all radio transmissions (including outgoing IFF interrogation signals) are blocked, with the exception of encrypted response messages of the Identification Friend-or-foe system transponder, including masking the transmission of a response message in the background noise frequency range of the broadcasting band (FM, TV) and using more long pauses in response intervals to interrogation signals (other radio strategies are possible to remain unnoticed)
  • this mode enables the IFF mode of the same name in the Radio Detection modes section, if it has not been enabled
SD Short distance visible only
  • only short range networks such as Bluetooth, Wi-Fi Direct (P2P) and UHF are used with limited transmission power over short distances
FULL Zero emission
  • all radio transmissions are blocked, only reception (completely passive mode), IFF mode is automatically turned off (and vice versa, when changing Stealth mode to another, IFF mode is turned on again)
  • in full stealth mode, the user will not be able to turn on the flashlight and loudspeaker
OFF OFF
  • does not restrict radio transmission
Vitals body tracking modes

OR condition when selecting presets (selecting one preset cancels the selection of the previously selected preset)

WRK Workout mode
  • Vitals body data-driven monitoring including: HR bpm (ECG)[11] - assessment of rhythm and heart rate; NIBP mmHg (ART) - blood pressure; TEMP - body temperature; StO₂ % - non-invasive method for monitoring the level of oxygen saturation (saturation); ETCO₂ % - (capnometry) to measure the level of carboxyhemoglobin (COHb) and methemoglobin (MetHb); RESP bpm (RR) - Respiratory Rate; HYDRL - determines the amount and frequency of hydration
  • displays tips for the user in case of many unwanted risks: bradycardia, tachycardia, arrhythmia, hypothermia, hyperthermia, hypoxemia, hyperventilation, hemorrhagic shock, etc.
  • when a dangerous level of indicators occurs, displays a message to the user and sends an SOS message to the analytical center
  • keeps a log of monitoring states
TRN Training mode
  • additionally takes into account the duration of the session of training exercises and the possibility of live fire training
  • applies a programmatically set training mode for the use of automatic tourniquets
TACT Tactical mode
  • in addition to the above, if a dangerous level of acute massive blood loss occurs in one of the 8 sites protected by automatic tourniquets, it controls the "Care Under Fire" task for stop of acute bleeding and start emergency automatic fluid resuscitation
  • if there is a risk of ventricular fibrillation, it automatically starts the defibrillation procedure under ECG control (cardio resuscitation)
  • if necessary, start automatic pulmonary resuscitation using pneumatic pumps built into the design of air filters
OFF OFF
  • does not monitor
Networks modes /

Com status AND

Signal levels Network 1, 2, 3, 4
  • displays a scale with the bandwidth level of each connected network
  • displays the status of receiving and transmitting packets
  • displays the packet transmission prohibition
  • long click launches NET application

Signal levels, upload / download transmission status

online
back soon
don't disturb
offline

Left main menu (LMM) and Right submenu (RSB)

redirect Further information: Public:Applications, Public:Voice User Interface

Left Center Right
LMMP Left main menu fading pads SBP Status bar fading pads RSBP Right submenu fading pads
LQMP Left quick menu fading pads CLW Central left window RQMP Right quick menu fading pads
LFSP Left features sidebar fading pads CRW Central right window RFSP Right features sidebar fading pads
LUW Left Upper window CWJP Central window joystick pads RUW Right Upper window
LTAW Left Top A window CWBP Central window buttons pads RTAW Right Top A window
LTBW Left Top B window RTBW Right Top B window
LBAW Left Bottom A window RBAW Right Bottom A window
LBBW Left Bottom B window RBBW Right Bottom B window

The main menu (LMM) is located at the top left of the visible area and contains a list of sections.

Only 7 elements for quick selection in one row. Use the navigation arrows on the right to select the next row. The main menu is only displayed on hover or on a voice call. When inactive, hides after 15 seconds. Each element is located in a separate field (fading pad). Only the fields that display the section are shown.

The right submenu (RSB) is at the top right and expands the second lower level of the main menu items. Only 7 elements in one row. The arrows on the left are used for navigation. The right submenu is displayed only when one of the main menu items on the left (LMM) is active or when the submenu item is directly called by voice. When inactive, hides simultaneously with the main menu after 15 seconds. Each element is located in a separate field (fading pad). Only the fields that display the section are shown.

When an app is opened using this menu, it is displayed on the screen. If the user closes the app, it does not stop its work, but continues to work in the background, at the same time, an element with the name of this application appears in the Left quick menu (LQM) or Right quick menu (RQM) menu field to quickly return to the screen. See the sections Left quick menu (LQM) and Right quick menu (RQM) below for how to completely terminate the application.

LMM v1.0
LMM v1.0


Widgets menu v1.0
Widgets menu v1.0



The sub-elements of the main menu and sub-menu are controlled by clicking (joystick, gesture control) or by voice. States:

  • Hover state: 4 corner field frame segments
  • Click state: frame on the field border (animation effect, twice 100 ms)
  • Selected (long click >2 s): horizontally placed two rectangles to the right and left of the caption
  • Not selected (long click >2 s): there are no horizontally placed two rectangles to the right and left of the caption

Differences in voice control:

  • The command to the voice assistant contains a description of the desired action and state, so it is faster
  • The voice assistant understands different interpretations of actions and states, so there is no need to memorize voice commands
  • During a voice call, not the entire menu is shown, but the corresponding items of the main menu and submenu
  • The user can voice the display of the entire menu
LMM RSB Action Notice
MSG

(Messenger)

IMSG (instant messaging system)
  • displays the IMSG application in a window
  • an IMSG application usually does not require the use of a fading window
CHAT (multichannel chat)
  • displays the CHAT application in a window
  • displays in the RFS (right features sidebar) field below the icons of several recently used chats (one-to-one and group)
  • if there are unviewed messages marked as important, the chat icons in the RFS field are displayed in red (automatic sorting of such chats)
  • if there are messages that require a response, the chat icons in the RFS field are displayed in yellow (automatic sorting of such chats)
LMM for all channels, RSB and RFS for the corresponding channel:
  • A counter of notifications of messages requiring a response is displayed at the top (yellow color)
  • Below is the number of unread messages (azure color)
MAIL (eMail)
  • displays the MAIL application in a separate window
SDR2 (SDR 2-way)
  • displays the SDR2 application in a separate window
CRPT (cryptologic control)
  • launches the CRPT application in a separate window
PTTH (PTT headset)
  • uses the built-in headset function for a handheld portable or manpack radio connected with a 4-pin cable (1-ch) or 5-pin cable (2-ch); for the PTT ("push-to-talk") function, use the A button on the left headphones ear cup
  • allows you to use a programmatic way, where instead of pressing, a voice command is used
TSK (Tasks)
  • OVDU (Overdue)
  • ONGO (Ongoing)
  • ASST (Assisting)
  • SBME (Set by me)
  • FLWG (Following)
  • CMNT (Comments)
  • DONE (Done)
The task management system allows you to plan and control the deadline, accuracy, results, and efficiency of tasks. Contains a description, checklist, deadline, actual completion time and elapsed time (including auto-tracking of completion and accounting of elapsed time), notification of the current status, geolocation at the time of completion, task completion confirmation artifacts, attachments, comments
  • In the upper right corner, a counter of notifications about overdue tasks and with an approaching deadline is displayed
  • The number of tasks for today is displayed in the lower left corner
CAL (Calendar)
  • DAY (Day)
  • WEEK (Week)
  • MNTH (Month)
  • YEAR (Year)
The event calendar allows you to plan and coordinate events in advance that require certain time regulations: collective online and offline communications, individual classes and trainings, meetings, training seminars, TDY (temporary duty) trips, and deployments
  • In the upper right corner, a counter of notifications of upcoming events is displayed
  • The number of events for today is displayed in the lower left corner
WGR (Workgroups)
  • TAC (Tactical)
  • ISR
  • FSUP (Fire support)
  • FAIR (Fast air)
  • MAS (Medical assistance)
  • EVAC (Evacuation)
  • LOG (Logistic)
The submenu contains filters for groups.

You can select a member or group in the appropriate section to communicate, share data, send or request a position. CDI element (Cross-Domain Interaction)

  • The number of available group members is displayed in the upper right corner
  • The number of active workgroups the user is a member of is displayed in the lower left corner
MAP

(Maps & Navigation)

CMPS (Compass)
  • displays the CMPS application in the LUW window
  • shows azimuth and elevation in degrees
NAV (Navigation)
  • displays the NAV application in a separate window
  • allows using GPS or RDF (radio beacon triangulation) to determine the location on a local map
  • allows you to calculate distances, travel time, perform route optimization
PATH (Path tracking)
  • displays the PATH application in a separate window
  • allows you to track the distance traveled and marks points on the map with the time
  • integrated with the TSK application for automatic execution of tasks related to changing positions
PLAN (Mission planning)
  • displays the PLAN application in a separate window
  • allows to plan the mission in detail in terms of tasks (route, time, resources, targets, threats, communications, ISR tasks, logistics, necessary reports)
  • integrated with BMS (Battlefield Management System) and TSK app
  • integrated with L-STE (Live-Synthetic Training Environment)
  • significantly optimizes time and resources, improves mission efficiency
ANLS (Mission analysis)
  • displays the ANLS application in a separate window
  • allows you to analyze the performance of the mission in real time, taking into account the deviation from the mission plan by different domains and divisions
  • integrated with BMS (Battlefield Management System) and TSK app
  • integrated with L-STE (Live-Synthetic Training Environment)
  • significantly reduces risk and increases mission consistency
SINT

(SIGINT)

SDRS (SDR Scan)
  • displays the SDRS application in a separate window
  • allows you to analyze radio frequency 2D / 3D spectrum and waterfall diagram in the range of 2 kHz - 6 GHz with different modulations
  • allows you to listen to unencrypted analog and digital radio broadcasts
  • allows you to analyze patterns of radio frequencies, incl. masked in bands not used for communications
  • allows you to analyze the safest and most unloaded frequencies for communication, transponder (IFF), remote control (RC)
RDF (Radio Direction Finding Control)
  • displays the RDF app in an overlap mode in the IFF / NAV app window or in a separate window
  • allows you to perform positioning in the conditions of a distorted GPS signal through triangulation by radio beacons
  • allows you to determine the direction and distance to the source of the radio signal of interest, detected using the SDRS application
PCSR (Passive covert radar control)
  • displays the PCSR app in an overlap mode in the IFF / NAV app window or in a separate window
  • allows using a passive program-controlled antenna to receive reflected radio signals in the FM range to detect aircraft and equipment, while not detecting itself (without using the radiation of the radio signal of its own radar)
RWRC (Radar warning receiver control)
  • displays the RWRC app in an overlap mode in the IFF / NAV app window or in a separate window
  • allows using a passive antenna to detect the radiation of directional radars and determine the course in relation to them
  • integrated with the IMSG and TSK app for fast response to threats
APAR (Active phased array radar control)
  • displays the APAR app in an overlap mode in the IFF / NAV app window or in a separate window
  • allows remote control of an active radar at a safe distance
RFDD (RF Drone Detection Control)
  • displays the RFDD app in an overlap mode in the IFF / NAV app window or in a separate window
  • allows using a passive antenna to detect a radio signal between the drone and its operator, determine the distance
EODD (RF EOD Detection Control)
  • displays the EODD app in an overlap mode in the IFF / NAV app window or in a separate window
  • allows using a portable wearable metal re-radiation radar (MET3R) to detect anti-tank mines, metal anti-personnel mines (including those with remote control), IEDs and trip wires
  • integrate with CVC application for additional use of Computer Vision, especially against plastic anti-personnel mines
RC

(Remote Control)

RPAC (Drone RC)
  • displays the RPAC app in a separate window
  • allows to control different models of drones using the built-in controller (land, waterborne and aerial drones)
  • allows to use the tilt of the head as one of the manipulators (instead of the joystick) and the joystick on the right headphones ear cup to control
  • allows to use one joystick to control two manipulators
  • allows to use Hand Tracking to control software joysticks and buttons
  • allows to use a voice assistant TESS and AI (Artificial Intelligence) technology for hands-free control
  • allows to use built-in navigation without using a separate front-facing camera for navigation
RBRC (Robot RC)
  • displays the RBRC application in a separate window
  • allows to remotely control the robot, similar to controlling a drone
FTRC (Fire turret RC)
  • displays the FTRC app in a separate window
  • allows to remote control of the small arms turret
UVRC (Unmanned vehicle RC)
  • displays the UVRC app in a separate window
  • allows to remote control a vehicle, similar to controlling a drone and a robot
WIKI (Wiki)
  • MAN (Manuals)
  • RPT (Reports)
  • ART (Articles)
  • UPD (Updates)
  • TUT (Tutorial)
Wiki systems are proven to be effective in creating and sharing the knowledge that everyone needs on an almost daily basis. This system allows for to a collection of best practices and improves the process of learning and training, as well as refreshing knowledge from time to time even from experienced users. All sorts of information about the technical arrangement and maintenance of equipment, the organization of processes at military bases, schedules, analysis materials of military experts, etc. Something that will help you become more efficient. Of course, distributed access rights, information protection, and confidentiality are in accordance with current protocols
  • The issues of security, protection against unauthorized access, confidentiality and ensuring uninterrupted access of users to the network, we intend to detail in a separate article.
  • Most likely, this process will be transferred to the developers of one of the DoD agencies (CYBERCOM) and the NSA as part of a deployment of the system (I am sure that these issues will not be within our competence)
MMD (Multimedia) REC (multimedia recorder)

PLAY (multimedia player)

  • launches the REC/PLAY app as the tab of the MMD app group window (tabs: REC, PLAY, VM, TRSL) or in a separate window
VM (Virtual mentor incl. video chat)
  • launches the VM app as the tab of the MMD app group window (tabs: REC, PLAY, VM, TRSL) or in a separate window
  • video conferencing system that allows remote data streaming with video, voice, text and file sharing
  • allows remote mentoring assistance in the context of medical care, incl. Care Under Fire, repair and maintenance of equipment, experienced mentors online to observe the training process and help correct mistakes
TRSL (Translater)
  • starts the TRSL application in the background without opening a window
  • allows, based on the AI small language model, to translate the text, taking into account the context and specialized terms
  • integrated with STT (speech-to-text) services and CV (Computer Vision) system to generate source material for translation
FILE (File explorer)
  • FAV (Favorites)
  • FLR (Folders)
  • CLD (Clouds)
  • TAG (Tags)
  • launches the FILE application in a separate window
  • the specified filters allow to quickly and easily find the files you need
  • additionally applies full text search, search by date, time, data format, size, author, etc.
PROC (Processing Control) CVC (Computer Vision Control)
  • launches the CVC app in an overlap mode in the CAM app window
  • allows to configure of presets and additional widgets for simultaneous use with other apps in the same window (overlapping) and use the streaming data of these apps
  • applies AI methods
  • allows to flexibly configure the rules for using your own, cloud and peer-to-peer (P2P network) computing resources
  • allows to configure methods and conditions for optimizing loads in different cases
CAC (Computer Audition Control)
  • launches the CAC app in an overlap mode in the CAM / IFF / NAV apps window or in a separate window
  • allows to customize presets and AI algorithms
  • allows load optimization for different apps
IFF (IFF Control)
  • launches the IFF application in a separate window
  • allows using transponder data of other users and generalized data of other detection systems (SDRS, RDF, CVC, CAC, PCSR, RWRC, APAR, RFDD, satellite data, and data of other users) in the navigation mesh mode
  • allows to automatically and manually mark the statuses of detected people, vehicles and objects
  • applies AI methods
STM (Stealth Modes Control)
  • launches the STM application in a separate window
  • allows you to configure presets for different stealth modes for the radio
FA (Firing Assistance Control)
  • launches the FA app in an overlap mode in the CAM app window
  • allows to execute real-time of ballistic calculations for small arms and mortar fire
  • allows to use all types of sighting devices
  • allows to configure presets and a widget to work with other applications in the same window at the same time and use the streaming data of these apps (drone / robot / turret cams view)
  • applies AI methods
VBS (Vitals Body Sensors Control)
  • launches the VBS app in a background ormode in a separate window
  • allows to set up presets and integration with sensors
  • allows accurate monitoring of vital signs in any position and on the move
  • based on Machine Learning algorithms and medical scientific data, it assesses the presence of dangerous and critical conditions, in the event of which it sends messages and independently controls medical devices (automatic tourniquets, difibrillator as cardio resuscitation and after support, fluid resuscitation, pulmonary resuscitation)
  • applies AI methods
ANTC (Antennas Control)
  • launches the ANTC app in a separate window
  • based on the built-in VNA antenna analyzer, determines the impedance (impedance factor), SWR (standing wave ratio for matching with the feeder path), radiation pattern, gain, and other characteristics of retractable and software-defined antenna for tuning in a specific radio session
  • advises the user on antenna tuning recommendations or controls the software-defined antenna itself
DVC (Integrated devices)
  • SGHT (Digital sights driver settings)
  • DRON (Drones and bots driver settings )
  • RADR (Radars driver settings)
  • SENS (Other Sensors driver settings)
  • launches the ANTC app in a separate window
  • allows to configure integration with external devices
  • allows to download new drivers and test functionality directly on the device to find errors
  • allows to roll back (undo) to the previous driver in specific specified cases
NET (Networks)
  • VHF
  • UHF
  • HF
  • 3/4/5G
  • WLAN
  • BT
  • P2P
  • launches a NET app in a separate window
  • allows to connect and disconnect for wireless networks, analyze network bandwidth, set network selection priorities for each type of data and for each app
  • allows real-time analysis of data exchange across networks
  • allows to configure rules for P2P networks, participants, resource allocation for multi-party computing, rules for user view exchange
SYS (System) CAM (Cameras Control)
  • launches the CAM app in a separate window or in multiple windows at the same time
  • allows to set up presets and integration with other apps
  • allows to perform digital zoom, interpolation to improve image quality and edge detection, use filters, deep processing of images and real-time video, mix channels and signals from 4 different sensors
  • dynamically detect contours and highlight them on the screen
  • calibrate and adjust the stereo camera for accurate distance measurement
  • integrated with other applications to use external cameras, Computer Vision technologies, Fire Assistant
DISP (Display Control)
  • launches the DISP app in a separate window
  • allows to customize presets and work with different apps
FPAD (Fading Pads Control)
  • launches the FPAD app in a separate window
  • allows ou to customize presets and work with different apps
MMC (Multimedia Control)
  • launches the MMC app in a separate window
  • allows to customize presets and work with different applications for multimedia devices: headphones (2), embedded microphones (11), handheld radio via built-in headset and voice software headset, loudspeaker (1)
11 embedded microphones:
  • 6 omnidirectional (built-in airway obturator, boom microphone with a windproof pad on the flexible goosneck, front, left and right headphones ear cups, back)
  • 2 super-cardioid (front, -35 / +35° angle)
  • 3 ultra-cardioid (front, -10 /0 / +10° angle)
TESS (Voice assistant)
  • launches the TESS app in a separate window for configuration and management
  • this application is a small language model with the possibility of learning on the dataset of a specific user and many users of this platform
  • applies AI methods
HT (Hand tracking system)
  • launches the HT app in a separate window for configuration and management
  • this application is based on Computer Vision technology for recognition of the user's hands in the field of view of a stereo camera
  • has the ability to learn new gestures on the dataset of a particular user and many users of this platform
  • applies AI methods
STT (Speech-to-text settings)
  • launches the STT app in a separate configuration and management window
  • has the ability to adapt to different pronunciations
  • integrated with the TESS application for perception of text in the context of semantic categories
  • applies AI methods
VOVR (Voiceover settings)
  • launches the VOVR app in a separate window
  • allows you to speak text and commands in multiple voices
INP (Joystick and buttons settings)
  • launches the INP app in a separate window
  • allows you to configure and calibrate physical and software input devices: buttons and joysticks
GNSS (GNSS)
  • launches the GNSS app in a separate window
  • allows you to set up communication with geospatial positioning satellites (GPS, Galileo, QZSS), track positioning errors, issue messages to the user
ACC (Accounts & Sync)
  • launches the ACC app in a separate window
  • manages the user profile and authorizes it to access cloud data on the network and within the peer-to-peer network
SEC (Security)
  • launches the SEC app in a separate window
  • allows to configure: password, emergency alert, emergency SOS, lock & unlock
  • must comply with the requirements of security, data protection, established by the protocols of defense agencies and information security agencies
ADM (Admin only)
  • launches the ADM app in a separate window
  • provides access to administrators, incl. remote access, for error control, correction and user assistance, as well as for maintenance and updates
SRV (Services)
  • launches the SRV app in a separate window
  • allows administrators to configure the operation of software services and embedded devices: Time and Date, Notifications, LED Spotlight settings (SPOT), Battery saver (BSVE), Water saver (WSVE), Accelerometer, Gyroscope, Hall sensor, Barometer, Thermometer, Ambient light sensor, Humidity sensor, Gas sensor (CO, NO2), Radiation sensor
  • launches scheduled calibration, automatically sends a report to the analytical system

Left quick menu (LQM)

Displays hides (within a frame) and open app windows on the left half of the screen. To completely stop the app, you need to perform a long click and press confirmation in the notification window.

Right quick menu (RQM)

Displays hides (within a frame) and open app windows on the right half of the screen. To completely stop the application, you need to perform a long click and press confirmation in the notification window.

Left features sidebar (LFS)

Displays:

  • functional buttons of some active apps in the left half of the screen, when there are a lot of them and it is undesirable to reduce the visible area of ​​the application window
  • list of priority tasks for the TSK application
  • list of recently viewed articles for the WIKI app
  • list of peer-to-peer leads for P2P application and their real-time characteristics
  • priority channel list for WGR application

Right features sidebar (RFS)

Displays:

  • function buttons of some active apps in the right half of the screen, when there are a lot of them and it is undesirable to reduce the visible area of ​​​​the application window (for example, SDRS)
  • CHAT app dialog list and dialog filters
  • list of recent commands via the IMSG app
  • list of taken photos and videos for the PLAY application
  • list of video conferencing participants for VM application

Virtual control tools

Displays:

  • Software (duplicated and synchronized with hardware) joysticks and buttons for controlling a drone, robot, turret, unmanned vehicles
  • Software buttons for controlling cameras of drones, robots and unmanned vehicles
  • Joysticks and buttons to control the movement of positions on the map and mark waypoints
  • Multimedia control and navigation buttons

Windows items description

redirect Further information: Public:Applications

Fading windows and pads


Pads-100
Pads-100


Left Center Right
LMMP Left main menu fading pads SBP Status bar fading pads RSBP Right submenu fading pads
LQMP Left quick menu fading pads CLW Central left window RQMP Right quick menu fading pads
LFSP Left features sidebar fading pads CRW Central right window RFSP Right features sidebar fading pads
LUW Left Upper window CWJP Central window joystick pads RUW Right Upper window
LTAW Left Top A window CWBP Central window buttons pads RTAW Right Top A window
LTBW Left Top B window RTBW Right Top B window
LBAW Left Bottom A window RBAW Right Bottom A window
LBBW Left Bottom B window RBBW Right Bottom B window

As it was already written at the very beginning of the description of the user interface, fading windows and pads are used in the device for contrast display. Otherwise, on a light and bright background of the environment, it will be difficult for the user to see images with contrast. Fading windows and pads, depending on the brightness modes, have different degrees of transparency. And in the case of bright light, they additionally perform the function of a sun screen.

App windows are placed in a larger and better viewable area. There are 12 independent windows in total (8 large 1.78:1, 2 large 1.20:1, 2 small 19.86:1), each containing control elements when the window is clicked or voice selected (selected state). A non-selected window is a passive window that only displays app graphics, window control elements can be hidden, app control elements can be hidden. Windows of different apps have different display priority, which is configured in the system settings for each application. Depending on the selected preset in the Status bar (SB), the configurations of the displayed windows can be quickly and flexibly changed by the user.

(!) Insert gallery with pictures of examples



Window subelements are controlled by clicking (joystick, gesture control) or by voice. States:

  • Hover state: thick dotted line along field border
  • Click state: frame on the field border (animation effect, twice 100 ms)
  • Selected (long click >2 s): sparse dotted line along field border
  • Not selected (long click >2 s): no dotted line

Differences in voice control:

  • The command to the voice assistant contains a description of the desired action and state, so it is faster
  • The voice assistant understands different interpretations of actions and states, so there is no need to memorize voice commands

The user can quickly and flexibly control the window configuration for each window individually:

  • The user can force close any window at any time by selecting the desired window (selected state), clicking on the "close window" icon (the app remains in the background, the app window is in a hidden mode, to reverse the action, click on the icon in the quick selection menu)
  • The user can maximize the left or right central window (CLW, CRW) to the entire area of ​​the central window (CW) (merged window will be 2.40:1) by selecting the desired window (selected state), clicking on the "maximize window" icon
  • The user can maximize the left or right window (LTAW, LTBW, LBAW, LBBW, RTAW, RTBW, RBAW, RBBW) to the entire left or right area of ​​the window (LW or RW) (merged window will be 1.78:1 x2) by selecting the desired window (selected state), clicking on the "maximize window" icon
  • When you click on the "minimize window" icon, the window returns to its original state
  • The "move window left" icon moves a window to the left, then up to the right, then to the left, changing the position of other windows
  • The "move window right" icon moves a window to the right, then down to the left, then to the right, rearranging other windows
  • The "share screen" icon allows you to send a screenshot of a window or enable broadcasting of this window for another user

Apps priority for windows



LUW CLW CRW RUW
  1. CMPS
  1. CAM (sight view, 2:1 maxi)
  2. RPAC (drone view) / RBRC / FTRC / UVRC
  3. EODD
  1. CAM + FA + CVC widgets
  1. NOTS (notifications, system messages)
  2. TIPS (user tips) + CHAT (new messages)
LTAW LTBW CWJP (left) CWJP (right) RTAW RTBW
  1. none
  2. TSK (2:1)
  3. DVC
  4. SYS
  1. none
  2. P2P
  3. WGR
  4. CAL
  5. WIKI (1:1, 2x)
  6. FILE (1:1, 2x)
  1. RPAC / RBRC / FTRC / UVRC
  1. RPAC / RBRC / FTRC / UVRC
  2. SDRS
  1. none
  2. CVC (setup)
  3. CAC (setup)
  4. FA (setup)
  5. NET (setup)
  6. SDR2 (setup)
  7. ANTC (setup)
  8. STM (setup)
  9. CRPT (setup)
  1. IMSG
  2. SDRS
  3. CHAT (1:2 maxi)
  4. MAIL (1:2 maxi)
LBAW LBBW CWBP (left) CWBP (right) RBAW RBBW
  1. CAM (RHD, (another) user view, drone view)
  2. MAP (NAV, PATH, PLAN, ANLS)
  1. IFF
  2. CA widget
  3. RDF
  4. RFDD
  5. RWRC
  6. PCSR
  1. RPAC / RBRC / FTRC / UVRC
  1. RPAC / RBRC / FTRC / UVRC
  2. SDRS
  1. RPAC (drone view) / RBRC / FTRC / UVRC
  2. CAM (RHD, (another) user view, drone view)
  3. MAP (NAV, PATH, PLAN, ANLS)
  4. MMD
  5. VBS
  1. CHAT (1:1 mini)
  2. MAIL (1:1 mini)
Window Mode Notice
Left Upper window (LUW) Usually used for a long time
Left top A window (LTAW) Used when necessary, not recommended during intense combat so as not to limit the visibility of the environment
Left top B window (LTBW) Usually used for a short time so as not to restrict the visibility of the environment
Left bottom A window (LBAW) Usually used for a long time
Left bottom B window (LBBW) Usually used for a long time
Central left window (CLW) Usually used for a short time so as not to restrict the visibility of the environment
Central right window (CRW) Usually used for a long time
Right Upper window (RUW) Usually used for a long time
Right top A window (RTAW) Usually used for a short time so as not to restrict the visibility of the environment
Right top B window (RTBW) Used when necessary, not recommended during intense combat so as not to limit the visibility of the environment
Right bottom A window (RBAW) Usually used for a long time
Right bottom B window (RBBW) Usually used for a long time

Movement of windows to the left and right

  • General rule "left to right, top to bottom" (list moving of 10 windows):
    • LTAW - left top window A
    • LTBW - left top window B
    • LBAW - left bottom window A
    • LBBW - left bottom window B
    • CLW - central left window
    • CRW - central right window
    • RTAW - left top window A
    • RTBW - left top window B
    • RBAW - left bottom window A
    • RBBW - left bottom window B
  • If the active window is on the left side and it moves to the left, it moves up the list
  • If the active window is on the left side and it moves to the right, it moves down the list in the left side, then from the left to the right in the center of the screen, then moves down the list in the right side
  • If the place where the active window is moved is not occupied by another window, other windows do not change their position
  • The other displayed window that the active window is moved down the list to is automatically moved up the list and takes the previous position of the moved active window
  • The other displayed window that the active window is moved up in the list to is automatically moved down the list and takes the previous position of the moved active window
  • Typically less than 10 large windows are displayed at the same time, so moving the active window does not move most other windows
  • If all 10 large windows are displayed, move the active window by several positions in the list causes the neighboring window to be sequentially automatically temporarily moved, which then returns to the previous position again
  • If the window is maximized and need to move, it is automatically minimized and moved according to the general rule, if necessary, it must be maximized manually again
  • The user can select two or more windows at the same time by holding down the D key (near the joystick) right headphones ear cup (similar to the right mouse button)
  • By selecting a window and holding down the C key (similar to the left mouse button) right headphones ear cup, the user can move the window or several windows at the same time with one action using the joystick - in this case, if a group of windows is moved, they will be located sequentially next to the list (even if in their previous location, they were not sequentially next to each other in the list)
  • Small windows (LUW and RUW) move only to the left or right in place of a similar small window
  • If the small window is moved to the right, the other window is moved to the left (swap)
  • If an app launches a small window while both small windows are displaying information from other applications, then the window with the app with the lowest priority is hidden in the shortcut menu (LQM or RQM)
  • If one small window closes, nothing is displayed in its place, to display the window of another app in this place, you need to click on it in the quick menu (LQM or RQM) or in the main menu (LMM and then RSB)
  • If an app launches a window that has a higher priority than an already occupied window, then the lower priority window is moved to another location, as dictated by the window and app priority rules. When closing a window with a higher priority, the window configuration returns to the previous state
  • If an application launches a window when there is no free more space to display windows, the window with the lowest priority is hidden automatically in the quick menu (LQM or RQM). When you close one of the windows with a higher priority, the previous window display state is restored. If you need to display a window with a lower priority, you need to make free space for it by minimizing one of the windows in the quick menu (LQM or RQM)

Scrolling the window by (4/5 of the window height or in rows - adjustable individually) is done using the up and down icons (scrollbar) or the joystick buttons "< +" and "->" from the bottom of the left or right headphones ear cup (similar to the PageUp, PageDown mouse buttons). Also smooth scrolling of the window with a joystick, voice command or gesture (including a virtual joystick or a separate gesture).

Window control icons, app control icons, app interface buttons located on the Left Features Sidebar (LFS) or Right Features Sidebar (RFS), virtual joysticks - refer only to the active (selected) window. For a passive window (not selected), they are not displayed. The exceptions can be customized, for example CHAT icons in RFS.

Separately for the window control icons - after the window has become active (selected), the window control icons are displayed for 15 seconds, after which they disappear (it can be in the settings disabled). To re-display them, select this window again. The active window's dotted highlight box is displayed for the duration of the window's active state.

For the not selected state you can click on another place on the screen or press the D button on the right headphones ear cup without click.

Also, forced use of some windows can act as a sunshield when the sun is low on the horizon in the line of sight. The user can move the window to the desired area and block the dazzling view of the sun without fading the entire viewing area.

Interface Animation

Interface items motion

  • common view
  • active view when working with the menu
  • the process of selecting a menu item (scrolling elements, changing the view when entering the submenu)
  • permanent (continuous) view (statuses, notifications, active menu items)
  • turning on and changing fading windows (rules, combination options in a simultaneous form)

Modern tools

  1. Qt + C++ (doc, wiki, quick start, framework modules, 6.2.4, QML, Qt Habr, Qt for Startups, Open Source Licences, download for GNL3 Open Source)
    • SaaS (sale) delivery under GPLv3 or LGPL3+ tech support + updates
  2. Electron.JS + React.JS + TypeScript
  3. MRTK-Unity is a Microsoft-driven project that provides a set of components and features, used to accelerate cross-platform MR app development in Unity. Here are some of its functions:
    • Provides the cross-platform input system and building blocks for spatial interactions and UI.
    • Enables rapid prototyping via in-editor simulation that allows you to see changes immediately.
    • Operates as an extensible framework that provides developers the ability to swap out core components.
    • Supports a wide range of platforms.
  4. Unity Mars helps solve the hard problems of AR app creation:
    • Overcome the challenges of authoring for dynamic physical environments
    • Reduce development time
    • Release cross-platform experiences with support for iOS, Android, and HoloLens

Manuals

Troubleshooting

Areas of research

Related fields

Future ideas

Further reading

See also

Public External Sections: Public Wiki Sections: Public Wiki Sections: Not-Public Wiki Sections:

Note: Unless otherwise stated, whenever the masculine gender is used, both men and women are included.


See also product details

Hardware Details: Functional Apps Details: Executive Apps Details: Service Apps Details:


References

External links