fbpx
01 / 05
Modernization and the Loss of Japan’s Samurai Culture Benefited the Japanese People

Blog Post | Health & Medical Care

Modernization and the Loss of Japan’s Samurai Culture Benefited the Japanese People

Economic, technological, industrial, and other progress radically improved the life of the ordinary Japanese citizen.

Summary: In the mid-19th century, Japan’s feudal society underwent a profound transformation during the Meiji Restoration, embracing Westernization and modernization. The shift from isolationism to openness resulted in rapid industrialization and technological advancements, improving living standards, education, and social mobility for ordinary citizens. This article examines Japan’s journey from a closed society to a prosperous nation, dispelling romanticized notions of the “good old days” and highlighting the benefits of progress and innovation.


Imagine you’re a farmer in Japan in 1850. You pay homage to your feudal lord, wear clothes of plain cotton, eat rice and fish, and are mostly preoccupied with surviving the occasional famine and outbreaks of disease. You likely have no education. Fifty years later, life has changed beyond recognition. Farmers now have an education, have fertilizer to farm with, have access to vaccination, and can use the telegraph and the postal service. They have more money to spend, more leisure time, and access to mass media.

The 2003 movie The Last Samurai portrays Japan during this period of modernization. The film laments the loss of traditional samurai culture amid rising Westernization. The film is inspired by the Satsuma Rebellion, a revolt from disaffected samurai amid the loss of their privileged position in society.

Longing for a privileged past is not unique to Japan; many in Europe romanticize the medieval era as one of knightly chivalry. However, such portrayals usually look at history through rose-tinted glasses. The “good old days” is a common fallacy, with facts becoming more distorted the further one looks back in history.

What really happened in the era of The Last Samurai?

The period takes places after the Meiji Restoration, showcasing the Westernization of Japan. Before this period, Japan was ruled by Tokugawa shogunate, a military dictatorship that had dominated the island for over 260 years. It imposed the foreign policy of Sakoku—that is, one of extreme isolationism. Aiming to reduce the spread of Christianity and cement the power of the shogun, the islands of Japan became closed to foreigners. No one was allowed to enter or leave Japan, and foreign trade was virtually nonexistent. (There was some trade allowed from the Dutch through the island of Kyushu, notably in porcelain.) This period was one of peace, which many in Japan welcomed after the Sengoku Jidai (a period of civil war) of the 1500s.

Conservatives in Japan welcomed this closing of the country to foreign influence. At the time, Japan was dominated by the samurai class. Samurai, while traditionally warriors, had moved in peacetime to become aristocratic bureaucrats at the service of their daimyo, a feudal lord. Samurai had a monopoly on military force and controlled most of education. Merchants were seen as a lower class, even lower than farmers. Feudalism, a system where a lord would rent out land in return for labor from the peasantry, had ended in parts of Europe around 1500. Whereas competition among European powers had created the emergence of a middle class, Japan had remained socially, technologically, and militarily stagnant from 1639 onwards.

As described by Mitsutomo Yuasa in his study The Scientific Revolution in Nineteenth Century Japan:

The traditional society (feudalism) before the Meiji Restoration, namely the age of Edo of Tokugawa Shogunate, was based on pre-Newtonian science and technology, and on pre-Newtonian attitudes towards the physical world.

In 1853, Japanese isolationism came to an end. With the arrival of Commodore Matthew Perry demonstrating a textbook example of gunboat diplomacy, the United States forced an end to Japanese isolationism and the opening of Japanese ports to American trade. In the years that followed, Japan established diplomatic relations with the Western Great Powers and underwent a collapse of the ruling Tokugawa shogunate.

Japan then went through a period of rapid modernization, importing Western technology, ideas, and culture. Ian Inkster describes the impact:

By 1855, Western machinery and factory organization had been introduced at Nagasaki for the maintenance of warships, and a spurt of building began in 1860 under Dutch leadership. It was Englishmen who in 1867 constructed the first steam powered spinning plant, the Kagoshima Spinning Factory. . . . By 1882, the Osaka Spinning Company operated 16 mules, 10,500 spindles and was practically powered by steam. . . . From 1870 to 1872, 245 railway engineers arrived in Japan from Europe. . . . Telegraphic communication was also established by the British from 1871.

The industries that were revolutionized by foreign influence included the iron industry, mining, railways, electricity, civil engineering, medicine, administration, shipbuilding, porcelain, earthenware, glass, brewing, sugar, chemicals, gunpowder, and cement manufacture. Japan developed its staple industry and export product, silk manufacturing and spinning, under guidance from a Swedish engineer using Italian methods. The silk industry also employed a large amount of female labor in Japan, with more women in the industrial labor force in Japan than in any other country in Asia.

The development of technological innovations improved Japanese industry. Ryoshin Minami showed the growth in total horsepower between 1891 and 1937 was in the order of 13 percent annually. The figure below shows the growth rate of development of primary industries during the period between 1887 and 1920, as well as overall economic growth. In many of the years during that period, growth in private non-primary fixed capital was in the double digits.

By the 1890s, Japanese textiles dominated the home markets and competed successfully with British products in China and India. Japanese shippers were competing with European traders to carry these goods across Asia and even to Europe.

The Satsuma Rebellion occurred in 1877, as Japanese government restricted the ability to carry a katana (long sword) in public. Regardless of one’s thoughts on the right to bear arms, the reduction in the power of the samurai class was a win for ordinary Japanese people. Having access to modern medical techniques, transportation, and goods benefited the whole society, rather than just feudal elites. Indeed, many of the samurai were able to adapt to their new roles in a modern Japan, working in business or government. In the 1880s, 23 percent of prominent Japanese businessmen were from the samurai class. By the 1920s, the number had grown to 35 percent.

By 1925, universal manhood suffrage had been implemented, a stark contrast from the Tokugawa shogunate. The social structure had loosened, allowing societal advancement far more easily than in the feudal era. By 1897, 95 percent of citizens were receiving some form of formal education, in contrast to 3 percent in 1853. With a more educated population, Japan’s industrial sector grew significantly. Of course, the new system still had its problems, such as labor strikes and industrial unrest. However, Westernization brought far more economic freedom to the Japanese people. Attitudes to commerce changed. Merchants rose from being the lowest class to becoming a vital part of the burgeoning middle class.

In Japan, progress was seen in economics, science, technology, education, consumer goods, industry, and social mobility. Society and the traditional order had been uprooted, in an example of Schumpeterian “creative destruction.” The inflow of new ideas, of new ways of doing things, allowed people to become freer, wealthier, healthier, and better educated. The opening of Japan was fundamentally an opening to progress. By isolating itself, Japan fell behind the rest of the world. As it opened itself to competition, it was able to catch up, and in some cases, surpass other countries. And the ordinary citizen of Japan was better for it.

Blog Post | Science & Education

AI in the Classroom Can Make Higher Education Much More Accessible

For some school subjects, artificial intelligence can transform the landscape of tutoring accessibility.

Summary: ChatGPT4 has demonstrated superiority in various student exams, revealing its potential to support academic learning and improve educational outcomes, particularly in test preparation. With its accessibility and affordability compared to traditional tutoring services, AI tutoring can help address the increasing demand for academic support, especially as universities begin to reinstate standardized testing requirements.


In 2023, OpenAI shook the foundation of the education system by releasing ChatGPT4. The previous model of ChatGPT had already disrupted classrooms K–12 and beyond by offering a free academic tool capable of writing essays and answering exam questions. Teachers struggled with the idea that widely accessible artificial intelligence (AI) technology could meet the demands of most traditional classroom work and academic skills. GPT3.5 was far from perfect, though, and lacked creativity, nuance, and reliability. However, reports showed that GPT4 could score better than 90 percent of participants on the bar exam, LSAT, SAT reading and writing and math, and several Advanced Placement (AP) exams. This showed a significant improvement from GPT3.5, which struggled to score as well as 50 percent of participants.

This marked a major shift in the role of AI, from it being an easy way out of busy work to a tool that could improve your chances of getting into college. The US Department of Education published a report noting several areas where AI could support teacher instruction and student learning. Among the top examples was intelligent tutoring systems. Early models of these systems showed that an AI tutor could not only recognize when a student was right or wrong in a mathematical problem but also identify the steps a student took and guide them through an explanation of the process.

The role of tutoring in education has grown in significance as more and more high school students have gone to college. Private tutoring is now a booming industry. Often you can find tutors charging anywhere up to $80 for test preparation with no shortage of eager parents willing to pay for their services. Tutoring has been a go-to solution for students to improve their grades outside the classroom. But more importantly, it has been a solution to improve their chances of getting into college, with many private tutoring services focusing on AP and SAT exams. This connection between college admission success and private tutoring costs has been a problem for parents who cannot afford the costs.

ChatGPT4 is available for $20 a month. Although the program itself can be used to answer questions and provide academic support, dedicated education websites have begun incorporating AI tutors to help with test prep. Khan Academy provides free courses on AP content and SAT exams and offers an AI-powered tutor for these subjects at $4 a month. Duolingo, a popular language learning app that offers university-recognized language exams, offers Duolingo Max at $14 a month. These tutoring services are accessible at your fingertips at any time. There is no need to schedule video conferencing calls, do background checks on tutors, or pay extra costs. Quality individualized academic support is available at a moment’s notice.

The availability of AI tutoring services is occurring at a crucial moment in education. As students become accustomed to post-pandemic life, student achievement across the nation still has not returned to where it once was. Despite that, many universities have begun reversing test-optional policies that had allowed students to avoid taking standardized tests such as the SAT. The demand for tutoring has skyrocketed as many new high school seniors struggle to meet the old standards of college admissions. Many school tutoring programs have not been able to provide the support students need, and private tutoring costs are only increasing.

AI has the potential to provide cheap and effective tutoring for these exams while being easily accessible. A Harvard computer science course has been able to incorporate ChatGPT to great success, using it to provide continuous and customized technical support and allowing professors to focus more on pedagogy. As technology improves, students will have more support for academic pursuits, opening an easier path to higher education but also allowing students to more easily explore academic interests beyond rigid classroom instruction.

Blog Post | Science & Technology

AI Is a Great Equalizer That Will Change the World

A positive revolution from AI is already unfolding in the global East and South.

Summary: Concerns over potential negative impacts of AI have dominated headlines, particularly regarding its threat to employment. However, a closer examination reveals AI’s immense potential to revolutionize equal and high quality access to necessities such as education and healthcare, particularly in regions with limited access to resources. From India’s agricultural advancements to Kenya’s educational support, AI initiatives are already transforming lives and addressing societal needs.


The latest technology panic is over artificial intelligence (AI). The media is focused on the negatives of AI, making many assumptions about how AI will doom us all. One concern is that AI tools will replace workers and cause mass unemployment. This is likely overblown—although some jobs will be lost to AI, if history is any guide, new jobs will be created. Furthermore, AI’s ability to replace skilled labor is also one of its greatest potential benefits.

Think of all the regions of the world where children lack access to education, where schoolteachers are scarce and opportunities for adult learning are scant.

Think of the preventable diseases that are untreated due to a lack of information, the dearth of health care providers, and how many lives could be improved and saved by overcoming these challenges.

In many ways, AI will be a revolutionary equalizer for poorer countries where education and health care have historically faced many challenges. In fact, a positive revolution from AI is already unfolding in the global East and South.

Improving Equality through Education and Health Care

In India, agricultural technology startup Saagu Baagu is already improving lives. This initiative allows farmers to increase crop yield through AI-based solutions. A chatbot provides farmers with the information they need to farm more effectively (e.g., through mapping the maturity stages of their crops and testing soil so that AI can make recommendations on which fertilizers to use depending on the type of soil). Saagu Baagu has been successful in the trial region and is now being expanded. This AI initiative is likely to revolutionize agriculture globally.

Combining large language models with speech-recognition software is helping Indian farmers in other ways. For example, Indian global impact initiative Karya is working on helping rural Indians, who speak many different languages, to overcome language barriers. Karya is collecting data on tuberculosis, which is a mostly curable and preventable disease that kills roughly 200,000 Indians every year. By collecting voice recordings of 10 different dialects of Kannada, an AI speech model is being trained to communicate with local people. Tuberculosis carries much stigma in India, so people are often reluctant to ask for help. AI will allow Indians to reduce the spread of the disease and give them access to reliable information.

In Kenya, where students are leading in AI use, the technology is aiding the spread of information by allowing pupils to ask a chatbot questions about their homework.

Throughout the world, there are many challenges pertaining to health care, including increasing costs and staff shortages. As developed economies now have rapidly growing elderly populations and shrinking workforces, the problem is set to worsen. In Japan, AI is helping with the aging population issue, where a shortage of care workers is remedied by using robots to patrol care homes to monitor patients and alert care workers when something is wrong. These bots use AI to detect abnormalities, assist in infection countermeasures by disinfecting commonly touched places, provide conversation, and carry people from wheelchairs to beds and bathing areas, which means less physical exertion and fewer injuries for staff members.

In Brazil, researchers used AI models capable of predicting HER2 subtype breast cancer in imaging scans of 311 women and the patients’ response to treatment. In addition, AI can also help make health resource allocations more efficient and support tasks such as preparing for public health crises, such as pandemics. At the individual level, the use of this technology in wearables, such as smartwatches, can encourage patient adherence to treatments, help prevent illnesses, and collect data more frequently.

Biometric data gathered from wearable devices could also be a game-changer. This technology can detect cancers early, monitor infectious diseases and general health issues, and give patients more agency over their health where access to health care is limited or expensive.

Education and health care in the West could also benefit from AI. In the United States, text synthesis machines could help to address the lack of teachers in K–12 education and the inaccessibility of health care for low-income people.

Predicting the Future

AI is already playing a role in helping humanity tackle natural disasters (e.g., by predicting how many earthquake aftershocks will strike and their strength). These models, which have been trained on large data sets of seismic events, have been found to estimate the number of aftershocks better than conventional (non-AI) models do.

Forecasting models can also help to predict other natural disasters like severe storms, floods, hurricanes, and wildfires. Machine learning uses algorithms to reduce the time required to make forecasts and increase model accuracy, which again is superior to the non-AI models that are used for this purpose. These improvements could have a massive impact on people in poor countries, who currently lack access to reliable forecasts and tend to be employed in agriculture, which is highly dependent on the weather.

A Case for Optimism

Much of the fear regarding AI in the West concerns the rapid speed at which it is being implemented, but for many countries, this speed is a boon.

Take the mobile phone. In 2000, only 4 percent of people in developing countries had access to mobile phones. By 2015, 94 percent of the population had such access, including in sub-Saharan Africa.

The benefits were enormous, as billions gained access to online banking, educational opportunities, and more reliable communication. One study found that almost 1 in 10 Kenyan families living in extreme poverty were able to lift their incomes above the poverty line by using the banking app M-Pesa. In rural Peru, household consumption rose by 11 percent with access to phones, while extreme poverty fell 5.4 percent. Some 24 percent of people in developing countries now use the mobile internet for educational purposes, compared with only 12 percent in the richest countries. In lower-income countries, access to mobile phones and apps is life-changing.

AI, which only requires access to a mobile phone to use, is likely to spread even faster in the countries that need the technology the most.

This is what we should be talking about: not a technology panic but a technology revolution for greater equality in well-being.

Blog Post | Education & Literacy

How to Combat Gloom and Pessimism

Given the inhospitable world we have evolved in, humans have learned to prioritize the bad news.

Summary: Optimism flourishes more in rapidly growing countries, fueled by the promise of improvements in living standards, a phenomenon less evident in relatively developed nations like the US. Human nature, predisposed to focus on negative news, collides with media outlets’ profit-driven emphasis on sensationalism, perpetuating a cycle of pessimism. Understanding our negativity bias and learning probabilistic reasoning skills can help navigate the deluge of alarming headlines, while seeking out sources of positive news can provide a more balanced perspective.


Surveys show that optimism is highest in rapidly growing countries that are catching up with the developed world. High growth rates allow the citizens of those nations to experience massive year-on-year increases in standards of living – something that, in the absence of an AI-led revolution in productivity, is unlikely to occur in already developed countries. Slow and steady progress, such as the one currently underway in the United States, does not seem sufficient to inspire widespread optimism about the future.

The problem of incrementalism is compounded by the interaction between human nature and the media. Given the inhospitable world we have evolved in, humans have learned to prioritize the bad news. Consequently, the media has embraced the “if it bleeds, it leads” business model. Worse still, growing competition between television, newspapers, and websites has significantly increased negative content over time. The inclusion of an additional negative word in a headline, for example, leads to 2.3 percent more clicks, according to a recent study.

Unfortunately, most people are unaware of our innate negativity bias. It may be helpful to include the understanding of basic human psychology in high-school curricula. While we may not be able to purge the negativity bias from our brains, understanding how and why we react to a ceaseless barrage of terrifying headlines in certain ways may help us gain a proper perspective on the world around us.

Another way to get around the apocalyptic headlines and focus on the largely positive trendlines is to develop a more sophisticated understanding of statistical probabilities. While evidence suggests that humans have an innate capacity for probabilistic reasoning, the formal application of Bayesian inference – which is to say, adjustment of our beliefs or guesses about something as we learn more information – is a learned skill. Infants and untrained adults show abilities that align with Bayesian principles on a basic level, indicating an intuitive understanding of probability and uncertainty. However, the precise and formal application of Bayesian reasoning requires education, especially in complex scenarios.

Finally, humans can choose what kind of information to consume. Knowing that traditional media does not offer a realistic picture of the world, people can sign up for services – such as the Human Progress weekly newsletter – that collate the positive happenings ignored by mainstream media outlets.