Artificial intelligence and IT security
The department Cognitive Security Technologies advances research at the intersection between Artificial Intelligence (AI) and IT security.
There are two main aspects:
Application of AI methods in IT security
Modern IT systems are characterised by rapidly growing complexity. The development of current and future information and communication technology opens up new, previously unforseen challenges: From the increasing networking of even the smallest communicatiing units and their combination to form the Internet of Things, to the global connection of critical infrastructures to unsecured communication networks, to the securing of digital identities: Modern society is confronted with the challenge of ensuring the security and stability of all these systems.
In order for IT security to keep pace with this rapid development, automation must be further developed and rethought. The Cognitive Security Technologies department researches and develops partially automated security solutions that use AI to support people in examining and securing security-critical systems.
Security of machine learning and AI algorithms
Just like conventional IT systems, AI systems can also be attacked. For example, it is possible to manipulate a face recognition AI through adversarial examples. Attackers can thus gain unauthorized access to security-critical access management systems that rely on AI systems. Similar attack scenarios also affect, for example, the area of autonomous driving, where humans must rely on the robustness and stability of assistance systems.
The Cogntitive Security Technologies department at Fraunhofer AISEC is researching how such weaknesses in AI algorithms can be found and eliminated. The department also offers tests for hardening such AI systems.