■ NewsInsight from the intersection of AI and business
Product updates, research, customer stories, and perspectives from the team building AI at S&P Global.
NewsArchive
An introduction to mitigating toxicity in LLMs
A vital aspect of “productionalizing” Large Language Models (LLMs) is to ensure a safe user experience and promote alignment with societal standards. LLMs excel at generating language and answering user-input questions, even some of the hardest ones. However, when given a malicious prompt, LLMs may also try to answer that with an unsafe response.
What is the future of generative AI beyond chat interfaces?
While chat-based AI models have dominated the landscape, the future of GenAI appears to extend beyond casual conversation. By acknowledging the limitations of chat for extended and diverse tasks and recognizing the suitability of both small and large models in specific scenarios, the trajectory of AI points towards integrated systems.
Postgres and OpenSearch: Mature data storage technologies and high-performance vector search engines
Postgres and OpenSearch: Mature Data Storage Technologies and High-Performance Vector Search Engines
Analyzing complex documents just got easier
Need help parsing your complex, messy documents? Kensho Extract has you covered.
NeurIPS 2023 recap
Welcome to our quick recap of NeurIPS 2023, a yearly conference that stands at the forefront of advancement in artificial intelligence. Last December, we had the incredible opportunity to attend many engaging talks and tutorials.
Learnings from the lab: Querying S&P Global’s tabular data using LLMs
Understanding complex data structures is a major challenge for Generative AI use cases. Kensho is designing specialized LLM-Ready APIs to tackle this problem.
Launched: S&P AI Benchmarks, a solution that evaluates LLMs for finance and business
Today we launched S&P AI Benchmarks by Kensho (Beta), a solution that assesses the abilities of Large Language Models (LLMs) to understand and leverage text that concerns finance and business. This exciting project, which combines S&P Global’s finance expertise with Kensho’s cutting-edge research and engineering, has witnessed substantial growth in the past year. It originated as an R&D initiative to fairly evaluate models, culminated in an academic research paper, and has now blossomed into a full-fledged resource for the industry at large.
Beyond innovation: Leveraging the power of machine learning for business growth
Discover the transformative role of GenAI and Machine Learning for business growth as it reshapes business operations and drives innovation in the era of AI.
Distributed training with Kubernetes
Neural networks are more relevant than ever with the rise of GenAI, in particular large language models, and at Kensho we’ve been employing them in a wide range of applications. However, training these complex models can be computationally intensive and expensive. In collaboration with our ML Research team, Kensho’s infrastructure team tackled this challenge using a multi-node approach that could be easily integrated into our existing infrastructure.
How human-reviewed machine-readable transcripts supercharge audio data
Machine-Readable Human-Reviewed (MRHR) transcripts merge modern technological capabilities with human reassurance to produce a transcription that is machine-readable and human-reviewed.
Introducing S&P Global Marketplace generative AI search
Announcing enhanced natural language search functionality utilizing large language models (LLMs). The initial release of Marketplace Generative AI search enables users to ask an array of questions — from simple data questions, such as a dataset’s geographic coverage or history, to more complex questions where answers are pulled from dataset user guides.
Automating application deployments at Kensho
Kensho’s AI product offerings encompass about 20 applications, including core services as internal services like a debugging dashboard and a customer authentication tool. As our AI products promote efficiency for our customers, we are also always trying to automate internal workflows, such as deployments, as well. A six-member SRE — Site Reliability Engineering — team is responsible for working with development teams to deploy these services to production clusters, collectively known as Hydra.
Navigating the data science landscape: My journey and a helpful guide
From grappling with the basics of math and statistics to diving into the world of coding, data manipulation, and visualization, I’ve learned that becoming a data scientist is not just about mastering skills — it’s about embracing a mindset of perpetual growth and innovation.
Unlocking the power of ASR: From transcription hassles to business advantages
In the ever-evolving landscape of innovation in Artificial Intelligence (AI), speech-to-text technology, or Automatic Speech Recognition (ASR), is a shining example of progress.
Kensho now offers a connection to Business Entity Cross Reference Service from its Link solution
Kensho Link can now connect not only to S&P Global CIQ IDs, but also all BECRS-provided IDs. This new unified service combines the ML-powered entity mapping accuracy of Link with the expansive company identifier data from BECRS into a single efficient workflow.
Lessons from my software engineer internship at Kensho
Danielle Lesinski shares her experience as a software engineer intern at Kensho.
What is data enrichment?
In today’s rapidly evolving digital landscape, data is more than just a collection of ones and zeros; it’s the lifeblood of modern businesses. We are excited to delve into the transformative potential of data enrichment and its profound impact on organizational strategies, customer insights, and overall success. Join us as we explore how this process, executed through innovative tools like Kensho NERD and Kensho Link, is shaping the future of decision-making.
Kensho Classify: The solution to common text classification challenges
Kensho Classify lets you find whether and where specific concepts occur in text, and is specifically tuned for business and finance.
Databricks Data + AI Summit (DAIS) 2023 top themes
In June, I had the chance to attend Databricks’ annual Data + AI Summit (DAIS) in San Francisco along with a team of my colleagues from S&P Global. In addition to showcasing our product and data offerings, we hosted a speaking session, Using Databricks to Power Insights and Visualizations on the S&P Global Marketplace.
Kensho NERD: Introducing People Linking
The most-requested new feature for Kensho NERD has arrived: recognizing and disambiguating people in financial documents.
■ Get startedTalk to our team about what’s possible
At Kensho, you’ll work at the intersection of trusted data, advanced AI, and real-world decision-making. We hire talented people and give them autonomy and support to develop cutting-edge solutions that solve complex business problems.