DARPA's Brian Sharkey Coins "Total Information Awareness" at DARPATech Conference

Opening

Brian Sharkey, Deputy Director of the Office of Information Systems Management at the Defense Advanced Research Projects Agency (DARPA), uses the phrase “total information awareness” in a presentation at the 1999 DARPATech conference (April 27-29, 1999, in Denver). The term describes a vision of integrating intelligence, defense, and law-enforcement databases with real-time communications monitoring to produce predictive awareness of emerging threats. Sharkey’s 1999 remarks are not a program announcement — Total Information Awareness as a formal program is established in January 2002 under John Poindexter’s direction after 9/11. But Sharkey’s 1999 presentation is the earliest public articulation of the conceptual architecture that the post-9/11 Information Awareness Office would attempt to implement, and it establishes the DARPA community’s pre-9/11 thinking about what would later become the defining surveillance architecture of the 21st century.

What Happened / Key Facts

The 1999 DARPATech presentation:

• Conference context: DARPATech is DARPA’s biennial symposium for academic and industry partners. April 1999 conference focused on information technology futures.
• Sharkey’s role: Deputy Director, Information Systems Office. Under SES-equivalent civilian leadership.
• Technical framing: Presentation described integration challenges — intelligence databases typically incompatible, law enforcement data stove-piped, commercial databases untapped. “Total information awareness” described the vision of making all of this integrable.
• Specific elements mentioned: Link analysis at scale, pattern detection across heterogeneous databases, translingual information retrieval, automated event extraction from unstructured text.

DARPA pre-9/11 research programs containing TIA elements:

• Genoa (1996-2001): DARPA IAO program led by Sharkey. Focused on analytic tools for intelligence integration. Genoa II (2002) became a principal component of the later formal TIA.
• EELD (Evidence Extraction and Link Discovery, 1998-2001): Link analysis across heterogeneous databases.
• Translingual Information Detection, Extraction, and Summarization (TIDES, 1999-2004): Multilingual text analysis.
• Human Identification at a Distance (HumanID, 1999-2003): Biometric identification at distance — gait, face, iris recognition. Later became controversial for civil liberties implications.

Post-9/11 formal program:

• January 2002: John Poindexter (Reagan-era National Security Advisor, Iran-Contra figure) appointed Director of the newly-created Information Awareness Office within DARPA.
• Sharkey’s role: Sharkey left DARPA in 2002; Syntek Technologies (the contractor he had worked with) became central to Poindexter’s program.
• August 2002: Poindexter publicly introduces the formal Total Information Awareness program at a DARPATech event.
• November 2002: New York Times publishes a critical article about TIA that triggers public controversy.
• September 2003: Congress defunds TIA in the FY2004 Defense Appropriations Act.
• 2003-onward: TIA’s constituent programs (many of which predated the formal TIA program) continue under alternative funding and organizational homes, including at NSA.

Why This Event Matters

The 1999 Sharkey presentation is the documentary artifact establishing that 21st-century integrated-surveillance architecture was a pre-9/11 DARPA research vision, not a reactive post-9/11 innovation:

• Establishes pre-9/11 origin of post-9/11 surveillance architecture. The public narrative of post-2001 mass surveillance is that it arose in response to the 9/11 intelligence failure. The 1999 Sharkey presentation demonstrates that the architectural vision was already developed in DARPA’s research programs before 9/11. The 9/11 attacks unlocked the funding and political space for deployment, but did not create the concept.
• DARPA as surveillance-architecture seed. DARPA’s pattern — fund long-horizon research that industry and operational agencies later commercialize — placed substantial surveillance-infrastructure research in the 1996-2001 R&D pipeline before any operational agency had funding to pursue it. Link analysis, biometric ID at a distance, translingual NLP, and heterogeneous database integration were all developed at DARPA before becoming operational surveillance tools.
• Poindexter/Sharkey/Syntek nexus foreshadows contractor-led architecture. The pre-9/11 personnel — Sharkey at DARPA, Poindexter at Syntek (a DARPA contractor) — became the post-9/11 personnel leading formal TIA. The revolving door between DARPA research programs and the contractor ecosystem is a structural feature of the post-2001 surveillance-industrial complex.

Broader Context

Brian Sharkey’s career trajectory exemplifies the DARPA-to-contractor pipeline: Naval Research Lab → DARPA (various positions through 2001) → Syntek Technologies → consulting for subsequent DARPA successor programs. The pattern provides continuity of technical expertise but also concentrates institutional knowledge in a small contractor ecosystem operating outside direct government oversight.

The 2003 congressional defunding of TIA is widely cited as an example of congressional restraint on surveillance overreach. But the defunding affected the formal TIA program name rather than the constituent research activities. Genoa II, EELD, TIDES, and related programs were transferred to other DARPA offices, to NSA’s research directorate, and to ARDA (Advanced Research and Development Activity, the intelligence community’s analog to DARPA). The 2006 NSA surveillance disclosures and 2013 Snowden material revealed that TIA-architecture capabilities were built at NSA despite the 2003 congressional action.

The 1999 Sharkey concept is the visible surface of a pattern that recurs: DARPA-funded research → operational deployment by intelligence/law-enforcement agencies → congressional concern → rebadged continuation under different program names. The arc runs from Sharkey 1999 through Poindexter 2002 through Snowden 2013 through 2025-2026 Palantir-ICE infrastructure.

Research Gaps

• Full text of Sharkey’s April 1999 DARPATech presentation — not publicly preserved in DARPA archives
• Specific 1998-1999 DARPA funding allocations to programs later absorbed into TIA — classified appendices to DARPA budget documents

Related Entries

• 1981-12-04–reagan-executive-order-12333-intelligence-activities
• 1997-06-01–nsa-sarc-signals-intelligence-automation-research-center-founded
• 2002-08-02–poindexter-announces-total-information-awareness-program
• 2003-09-24–congress-defunds-total-information-awareness-program