Artificial Intelligence (AI) promises to solve challenges both in the private and public sector. In industry, for example, future accountants and marketeers will share their day-to-day tasks with AI bots. In the public sector, AI could help governments to act more quickly in crisis situations or anticipate disasters. However, the fundamental question of how power dynamics influence the creation of an AI system, is not always addressed. Awareness about this issue is important because, for example, some stakeholders’ voices might have less value than those with more power or knowledge. Some might not get a seat at the table in the first place, resulting in reinforced societal inequality.