Goldman Sachs on data in the age of AI
๐กLearn how a top-tier financial institution structures data pipelines to support enterprise-scale AI initiatives.
โก 30-Second TL;DR
What Changed
Data engineering is the foundation for AI readiness
Why It Matters
Emphasizes that enterprise AI success is gated by data infrastructure rather than just model selection. Organizations must prioritize data governance to remain competitive.
What To Do Next
Audit your current data pipeline architecture to identify bottlenecks that could hinder large-scale model training or inference.
Key Points
- โขData engineering is the foundation for AI readiness
- โขQuality of data determines the efficacy of AI models
- โขStrategic data management is required for enterprise AI adoption
๐ง Deep Insight
Web-grounded analysis with 15 cited sources.
๐ Enhanced Key Takeaways
- โขGoldman Sachs has adopted an engineering-led approach to data, treating it as a first-class asset with a focus on platform engineering, content curation, and robust governance to support firm-wide functions from client service to AI.
- โขThe firm has open-sourced its data management system, Legend, to foster data interoperability across the financial industry, and integrates it with cloud platforms like Google Cloud's BigQuery and BigLake for enhanced data modeling and analytics.
- โขGoldman Sachs has deployed a secure, multi-model internal AI platform (GS AI Platform) that operates behind its corporate firewall, leveraging leading language models such as OpenAI's GPT-4, Google's Gemini, and Anthropic's Claude, and utilizing Retrieval Augmented Generation (RAG) for secure querying of private data.
- โขNeema Raphael, Goldman Sachs' Chief Data Officer, emphasizes that the world is facing a shortage of 'organic data' for AI training, underscoring the critical need for better utilization of existing enterprise data and the potential emergence of synthetic data markets.
- โขGoldman Sachs is actively piloting 'agentic AI' (AI 2.0) for autonomous tasks, including using AI software engineers like Devin for automated unit test generation, which has already shown a 180x speed increase in some coding tasks and a 20% boost in overall coding speed.
๐ ๏ธ Technical Deep Dive
- Goldman Sachs' core data architecture is being re-platformed onto AWS to achieve scalability and increased operational speed.
- The firm is developing a modern Lakehouse and AI data platform to enable reliable, governed, and high-performing data use.
- Legend, Goldman Sachs' open-source data management system, integrates with Google Cloud services such as BigQuery and BigLake for data modeling and analytics.
- The internal GS AI Platform is a secure, multi-model ecosystem operating behind the corporate firewall, employing Retrieval Augmented Generation (RAG) to allow AI to search and use information from private databases like internal compliance policies and transaction records.
- For software development, Goldman Sachs utilizes AI tools like Diffblue Cover for automated unit test generation for legacy Java code, significantly improving code coverage and reducing development time.
- The Marquee platform provides programmatic access to proprietary and third-party data via APIs and offers GS Quant, a Python toolkit for quantitative finance, enabling advanced analytics and backtesting.
- The firm is exploring agentic AI, which involves autonomous agents capable of executing complex, multi-step tasks independently, moving beyond passive assistance tools.
๐ฎ Future ImplicationsAI analysis grounded in cited sources
โณ Timeline
๐ Sources (15)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Bloomberg Technology โ
