How Smart is ChatGPT? – Visual Capitalist
Chart: U.S. Home Price Growth Over 50 Years
What are Top Investment Managers Holding in Their Portfolios?
Visualized: The 100 Largest U.S. Banks by Consolidated Assets
Visualizing Every Company on the S&P 500 Index
Visualizing BlackRock’s Top Equity Holdings
Ranked: The Most Innovative Companies in 2023
Ranked: America’s Largest Semiconductor Companies
Nvidia Joins the Trillion Dollar Club
Visualizing the Top U.S. States for AI Jobs
Ranked: The World’s Top 25 Websites in 2023
Ranked: The Most Affordable U.S. Cities for Home Buyers
Charted: Public Trust in the Federal Reserve
Charting the Rise of America’s Debt Ceiling
Ranked: The World’s Top 50 Endowment Funds
Comparing the Speed of Interest Rate Hikes (1988-2023)
Ranked: The Best U.S. States for Retirement
Timeline: Cannabis Legislation in the U.S.
Visualizing the Composition of Blood
Visualizing the Relationship Between Cancer and Lifespan
Explainer: What to Know About Monkeypox
Life Cycle Emissions: EVs vs. Combustion Engine Vehicles
Visualizing the World’s Largest Lithium Producers
Mapped: Renewable Energy and Battery Installations in the U.S. in 2023
How EV Adoption Will Impact Oil Consumption (2015-2025P)
Global EV Production: BYD Surpasses Tesla
Ranked: The Cities with the Best Work-Life Balance in the World
Mapped: The Growth in House Prices by Country
Mapped: Renewable Energy and Battery Installations in the U.S. in 2023
Ranked: The Cities with the Most Skyscrapers in 2023
Map Explainer: Sudan
Ranked: The World’s Biggest Steel Producers, by Country
Charted: 30 Years of Central Bank Gold Demand
Visualizing U.S. Consumption of Fuel and Materials per Capita
The Periodic Table of Commodity Returns (2013-2022)
Visualizing 25 Years of Lithium Production, by Country
Life Cycle Emissions: EVs vs. Combustion Engine Vehicles
Ranked: The 20 Most Air-Polluted Cities on Earth
Mapped: Air Pollution Levels Around the World in 2022
Visualizing the Flow of Energy-Related CO2 Emissions in the U.S.
Chart: Automakers’ Adoption of Fuel-Saving Technologies
Published
on
By
ChatGPT, a language model developed by OpenAI, has become incredibly popular over the past year due to its ability to generate human-like responses in a wide range of circumstances.
In fact, ChatGPT has become so competent, that students are now using it to help them with their homework. This has prompted several U.S. school districts to block devices from accessing the model while on their networks.
So, how smart is ChatGPT?
In a technical report released on March 27, 2023, OpenAI provided a comprehensive brief on its most recent model, known as GPT-4. Included in this report were a set of exam results, which we’ve visualized in the graphic above.
To benchmark the capabilities of ChatGPT, OpenAI simulated test runs of various professional and academic exams. This includes SATs, the bar examination, and various advanced placement (AP) finals.
Performance was measured in percentiles, which were based on the most recently available score distributions for test takers of each exam type.
Percentile scoring is a way of ranking one’s performance relative to the performance of others. For instance, if you placed in the 60th percentile on a test, this means that you scored higher than 60% of test-takers.
The following table lists the results that we visualized in the graphic.
The scores reported above are for GPT-4 with visual inputs enabled. Please see OpenAI’s technical report for more comprehensive results.
As we can see, GPT-4 (released in March 2023) is much more capable than GPT-3.5 (released March 2022) in the majority of these exams. It was, however, unable to improve in AP English and in competitive programming.
Regarding AP English (and other exams where written responses were required), ChatGPT’s submissions were graded by “1-2 qualified third-party contractors with relevant work experience grading those essays”. While ChatGPT is certainly capable of producing adequate essays, it may have struggled to comprehend the exam’s prompts.
For competitive programming, GPT attempted 10 Codeforces contests 100 times each. Codeforces hosts competitive programming contests where participants must solve complex problems. GPT-4’s average Codeforces rating is 392 (below the 5th percentile), while its highest on a single contest was around 1,300. Referencing the Codeforces ratings page, the top-scoring user is jiangly from China with a rating of 3,841.
Here are some areas where GPT-4 has improved the user experience over GPT-3.5.
A limiting factor with GPT-3.5 was that it didn’t have access to the internet and was only trained on data up to June 2021.
With GPT-4, users will have access to various plugins that empower ChatGPT to access the internet, provide more up to date responses, and complete a wider range of tasks. This includes third-party plugins from services such as Expedia which will enable ChatGPT to book an entire vacation for you.
While GPT-3.5 could only accept text inputs, GPT-4 has the ability to also analyze images. Users will be able to ask ChatGPT to describe a photo, analyze a chart, or even explain a meme.
Lastly, GPT-4 is able to handle much larger amounts of text and keep conversations going for longer. For reference, GPT-3.5 had a max request value of 4,096 tokens, which is equivalent to roughly 3,000 words. GPT-4 has two variants, one with 8,192 tokens (6,000 words) and another with 32,768 tokens (24,000 words).
Visualizing Global Attitudes Towards AI
Timeline: The Shocking Collapse of Silicon Valley Bank
Ranked: The Most Innovative Companies in 2023
Ranked: America’s Largest Semiconductor Companies
Nvidia Joins the Trillion Dollar Club
Visualizing the Top U.S. States for AI Jobs
Ranked: The World’s Top 25 Websites in 2023
Visualizing Global Attitudes Towards AI
Endowment funds represent the investment arms of nonprofits. See the worlds top 50, which collectively have over $1 trillion in assets.
Published
on
By
What do Harvard, the Church Commissioners for England, the NYC Metropolitan Museum of Art, and an entity on behalf of Saudi Arabia’s King Abdullah all have in common? They all have endowment funds.
An endowment fund is the investment arm of nonprofit institutions like universities, charities, and churches. The purpose of the fund is to invest the organization’s assets to fuel future operations and other important projects.
The world’s largest endowment funds have billions in investable assets, making them sizable players in the finance sector. Here, using data from Sovereign Wealth Fund Institute, we take a closer look at the world’s largest endowment funds by total assets.
Overall, there are four main types of endowment structures.
In addition, each endowment fund has different structures in regards to withdrawals, use of funds, and their general investment philosophy.
The largest endowment funds can be compared on a grand economic scale, in terms of assets.
To put it all into perspective, the largest 50 endowment funds represent over a trillion dollars in assets. Or for a more singular example, look at Harvard’s fund, which has an endowment greater than the entire GDP of countries like Serbia, Bolivia, or Slovenia.
Here’s how the top 50 rank.
The largest endowment fund, Ensign Peak Advisors, is based in Salt Lake City, Utah, and manages the assets for the Mormon Church (officially known as the Church of Jesus Christ of Latter-day Saints). The church itself has over 16 million members worldwide and is the fourth largest church in America.
The Japan Science and Technology Agency (JST) is a national research and development agency that plays a core role in promoting technology, innovation, and science within society. In 1995, Japan’s government passed the Science and Technology Basic Plan and the JST came to life and now has over $80 billion in assets as well as offices in Paris, Washington, Singapore, and Beijing.
Just two funds come from the Middle East. The King Abdullah University of Science and Technology (KAUST) with $23.5 billion and the General Authority of Awqaf. KAUST is ranked 95th amongst universities in the world and made history in the country by being Saudi Arabia’s first mixed-gender university.
The General Authority of Awqaf has $11 billion in assets and was established as a public authority to manage endowments and enhance Saudi Arabia’s various goals for societal development. “Awqaf” in Arabic loosely translates to assets that are donated or purchased for general or specific charitable causes that are socially beneficial.
On the environmental side is the Nature Conservancy, which has $7.8 billion in assets. The charity is estimated to have protected more than 100 million acres of land.
Universities are one leading category from the world of endowment funds, particularly those from the United States. In fact, universities make up 39 of the top 50 endowment funds, with 35 of them based in America.
Historically, Harvard has been the largest, but Stanford has edged ahead in recent years. Stanford has $75 billion in assets compared to Harvard’s $73 billion. These vast amounts of money have not gone unnoticed, and elite universities are facing mounting criticism in some circles.
“When Harvard’s total admitted freshman class is 1,400 people—and they have an endowment that is the GDP of El Salvador—they’re not a nonprofit, they’re a hedge fund educating the children of their investors.” – Professor Scott Galloway
With student debt rising to $1.6 trillion, it’s likely these universities may face greater criticism around how they use the wealth available to them in endowment funds.
The top endowment funds carry considerable influence within the world of finance. While they all have billions to invest, each has very different objectives and intentions on how to deploy their capital.
And despite being non-profit organizations, endowment funds are seeing their overall assets exceed those held by many other investment funds, such as sovereign wealth funds, hedge funds, and private equity firms.
Comparing Population Pyramids Around the World
Ranked: The Cities with the Best Work-Life Balance in the World
What are Top Investment Managers Holding in Their Portfolios?
Ranked: The 20 Most Air-Polluted Cities on Earth
Ranked: The Most Affordable U.S. Cities for Home Buyers
Chart: U.S. Home Price Growth Over 50 Years
Ranked: America’s Largest Semiconductor Companies
10-Year Annualized Forecasts for Major Asset Classes
Copyright © 2023 Visual Capitalist
