what Ukrainian developments are capable of

Machine vision on FPV drones

The Armed Forces of Ukraine will massively use FPV drones from 2022. This helps to compensate for the lack of means of destruction and significantly changes the rules of the game in war. For the enemy, this means that explosives can come from any direction and hit the most vulnerable place.

The Russians also picked up this idea and put the production of small kamikaze drones on the assembly line. And although the enemy’s factories are very powerful, and the Kremlin has unlimited financial resources, according to recorded cases of the use of FPV drones, Ukraine was able to overtake the Russian army in the spring.

Ukrainians take not only quantity, but also technology. For example, the Ukrainian drone Vampire, which the Russians also call “Baba Yaga”. It is capable of flying at night, purposefully dropping up to 20 kilograms of explosives and returning to the operator. Its first applications in 2022 were a very bitter surprise for the occupiers.

Anti-drone technologies are also not standing still. The most effective way to protect yourself from an FPV drone is to turn on the electronic warfare (EW) system. It suppresses the drone with its signal so that the operator loses communication and cannot direct the drone to the target.

Recently, mobile or “trench” ERBs, which can be installed anywhere, have become popular. If they operate at the correct frequencies, the drone will fall or hover in the air while approaching the target. Unfortunately, the enemy in EW technologies is still ahead. Therefore, the main task for Ukrainian designers is to make the drone operate on its own on the battlefield and make it less dependent on the operator. This is where machine vision comes to the rescue.

The idea is that the drone focuses its attention on a certain object and pursues it on its own even after losing contact with the operator.

Of course, machine vision has its drawbacks. For example, it is unlikely that in the near future he will be able to hit exactly the weak point of the tank and maneuver efficiently in case of adverse weather. However, this will definitely contribute to the growth of the percentage of hits, which currently remains small – about 20%.

The use of machine vision on drones actually eliminates EW and will allow to destroy the enemy more safely and on a larger scale. First in use will give a considerable advantage.

Now several teams are testing their solutions, but in this direction, the most dynamic state support is needed, which will take into account systemic approaches and direct investments, otherwise the scales may tip the other way.

Volunteer Serhii Sternenko demonstrated the operation of such an FPV drone. In the video, you can see how the Ukrainian drone captures the target at a long distance and after a few seconds loses contact with the operator. Nevertheless, the tank is still hit, because the drone flies to the target on its own.

Orientation in space

The concept of machine vision is also used on more complex weapons – cruise missiles. Modern missile models have several ways of navigating in space to increase accuracy and be able to maneuver at low altitudes with minimal risk of collision and detection by ground-based radars.

Therefore, in addition to the classic GPS satellite signal, other navigation systems can be installed on rockets. For example, TERCOM. The essence of its work is to load a terrain map into the rocket’s memory. Throughout the journey, the computer will compare the terrain that the rocket sees around it with the map it has loaded.

The rocket “sees” the terrain with the help of special radar equipment, so it can be called “machine vision” very tentatively. But the DSMAC system focuses on the image from the lens. The principle of operation is similar – photos of the area are loaded into the memory, and the computer looks for matches and determines the coordinates by analyzing photos from the on-board camera.

Usually, TERCOM and DSMAC complement each other. They are especially useful under the influence of EB. The first is used throughout the entire path, and the second – at the last stages of guidance.

Smart surveillance cameras

In the wars of the past, people were mostly sent to scout and patrol the front territory, which endangers their lives and does not guarantee high-quality detection of the enemy. The modern military has come to a logical solution, instead of people they use cameras with machine vision, which are able to determine the type of object, the distance to it, and in a matter of seconds, transmit the information to the headquarters.

The further the technological progress goes, the faster the processors become and the clearer the cameras see. And the most important thing is that technologies are becoming much more accessible. This paves the way for widespread use of cameras and machine vision across the front line.

In the West, similar devices are produced by the American company FLIR, the British Silent Sentinel, the Spanish Tanz, etc.

In Ukraine, such systems are serially manufactured by the Compass Engineering company under the name “ZIR” on the order of the Defense Forces. The principle of their work is as follows: the camera watches the position around the clock, tracking the possible appearance of enemy personnel, equipment or drones. As soon as the object is detected, the system fixes their coordinates and raises the alarm.

The location of the objects in real time is seen on their screens by the commanders at the stronghold and they make decisions about their elimination. For example, launching FPV drones at given coordinates.

The advantage on the battlefield lies in the minimization of the human factor – the machine alone indicates the threat and provides the necessary data for effective damage. These complexes can be integrated into other situational awareness systems and create the most complete picture of the battlefield for the higher command.

It is known that “ZIR” is already used by the State Border Guard Service. The realities of war require quick decisions, so Ukrainian border guards began to use this system in both stationary and mobile versions.

Autonomous complex “ZIR Pro” from Compass Engineering

Another promising area where Ukraine can use similar solutions is the search for Russian drones in the sky. Air Force radars are not capable of covering the entire country, so they have to find another mass and effective way to detect drones.

One of these can be the use of cameras located on the probable flight paths of the “shaheeds”. Compass Engineering tests showed that the “ZIR” complex sees them at a distance of about 7-10 kilometers, which is enough for the response of mobile groups. This can significantly help in the defense of our country. It is necessary to constantly modernize in order to win in the end.

Cameras with machine vision can be used in civilian life as well. For example, for early fire detection or security monitoring in crowded places. In the conditions of war, this is an effective way to compensate for reconnaissance vehicles in certain areas of the front and save the lives of Ukrainian defenders.