The system made a decision. The criteria are proprietary. The appeal process does not exist.
Literal meaning: A black box is any system — technical, social, or organisational — whose internal workings are not accessible to the observer. You can see what goes in and what comes out, but the process that transforms input into output is opaque. In technology, it describes systems that function without revealing their logic to users, regulators, or affected parties.
Origin: The term comes from engineering and systems theory, where it describes a component that can be understood only through its inputs and outputs. In science and technology studies, Bruno Latour used “black box” to describe facts and technologies that have become so accepted that their internal mechanisms are no longer questioned — they are treated as settled. Frank Pasquale’s The Black Box Society (2015) brought the concept into public policy debate, documenting how financial and digital systems make consequential decisions through processes that are deliberately opaque to regulation and accountability.
A system whose internal workings are unavailable for inspection — where the opacity is not incidental but structural.
The Appeal: Black boxes are sometimes efficient. Not every user needs to understand how a search algorithm works to benefit from search. Abstraction and encapsulation are legitimate engineering principles. The problem is not opacity per se but the power dynamics that opaque systems produce.
The Friction: The black box is not neutral. Obfuscation — deliberate opacity — is the active choice to make and keep systems opaque. Informatics of Domination — the reinscription of hierarchies through information systems — operates through black boxes: the hierarchy is encoded in processes that cannot be inspected. Algorithmic Violence — harm caused by automated systems — is the consequence of black box decision-making at scale: the decision happened, the harm was produced, but the process that connected them is not available for examination or challenge. Unblackboxing — opening what was designed to stay closed — is both the analytical practice and the democratic demand.
Why This Matters: Black box names the condition under which accountability becomes impossible. Once a consequential system is opaque, harm becomes structurally unaddressable. The demand for transparency is not a technical request — it is a political one.
Related terms: Obfuscation · Unblackboxing · Algorithmic Violence · Informatics of Domination · AI Dependency
Read more:
- The Black Box Society: The Secret Algorithms That Control Money and Information — Pasquale, F. (2015). Harvard University Press
- Science in Action — Latour, B. (1987). Harvard University Press