honda quality management case study

Help & FAQ

Case study: Honda of America manufacturing, Inc.: Can lean production practices increase environmental performance?

Management and Organization

Research output : Contribution to journal › Article › peer-review

This article covers the strategic, organizational, and operational decisions involved in one automobile manufacturer's efforts to balance its goals of productivity and high quality with the more elusive goal of environmental responsibility. The case material is based on the real-life experiences of Honda of America's two manufacturing plants in East Liberty and Marysville, Ohio. The case unfolds as the environmental manager in charge of the two plants faces the pending visit of her corporate boss from Tokyo, who has made it clear that environmental issues are of growing importance in Honda's overall direction. ISO 14000, the new environmental quality standards being adopted by some other manufacturers, serves as a focusing issue for the environmental manager's thinking, but this issue is really representative of a wider challenge facing the Ohio plants: balancing Honda's core mission of producing the best cars at the lowest cost possible, and being a responsible actor in the environmental arena. Complicating this challenge, the environmental manager has to negotiate another tension common in global manufacturing firms today: balancing the influence of Honda's corporate headquarters in Japan with the local and regional context at its American plant sites.

All Science Journal Classification (ASJC) codes

Waste Management and Disposal
Public Health, Environmental and Occupational Health
Management, Monitoring, Policy and Law

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1002/tqem.3310080107

Fingerprint

lean management Social Sciences 100%
Lean production Engineering & Materials Science 87%
environmental performance Earth & Environmental Sciences 71%
Tension Chemical Compounds 62%
manufacturing Social Sciences 58%
Managers Engineering & Materials Science 55%
Automobiles Medicine & Life Sciences 47%
manager Social Sciences 46%

T1 - Case study

T2 - Honda of America manufacturing, Inc.: Can lean production practices increase environmental performance?

AU - Maxwell, James

AU - Briscoe, Forrest

AU - Schenk, Brian

AU - Rothenberg, Sandra

N2 - This article covers the strategic, organizational, and operational decisions involved in one automobile manufacturer's efforts to balance its goals of productivity and high quality with the more elusive goal of environmental responsibility. The case material is based on the real-life experiences of Honda of America's two manufacturing plants in East Liberty and Marysville, Ohio. The case unfolds as the environmental manager in charge of the two plants faces the pending visit of her corporate boss from Tokyo, who has made it clear that environmental issues are of growing importance in Honda's overall direction. ISO 14000, the new environmental quality standards being adopted by some other manufacturers, serves as a focusing issue for the environmental manager's thinking, but this issue is really representative of a wider challenge facing the Ohio plants: balancing Honda's core mission of producing the best cars at the lowest cost possible, and being a responsible actor in the environmental arena. Complicating this challenge, the environmental manager has to negotiate another tension common in global manufacturing firms today: balancing the influence of Honda's corporate headquarters in Japan with the local and regional context at its American plant sites.

AB - This article covers the strategic, organizational, and operational decisions involved in one automobile manufacturer's efforts to balance its goals of productivity and high quality with the more elusive goal of environmental responsibility. The case material is based on the real-life experiences of Honda of America's two manufacturing plants in East Liberty and Marysville, Ohio. The case unfolds as the environmental manager in charge of the two plants faces the pending visit of her corporate boss from Tokyo, who has made it clear that environmental issues are of growing importance in Honda's overall direction. ISO 14000, the new environmental quality standards being adopted by some other manufacturers, serves as a focusing issue for the environmental manager's thinking, but this issue is really representative of a wider challenge facing the Ohio plants: balancing Honda's core mission of producing the best cars at the lowest cost possible, and being a responsible actor in the environmental arena. Complicating this challenge, the environmental manager has to negotiate another tension common in global manufacturing firms today: balancing the influence of Honda's corporate headquarters in Japan with the local and regional context at its American plant sites.

UR - http://www.scopus.com/inward/record.url?scp=27844457320&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=27844457320&partnerID=8YFLogxK

U2 - 10.1002/tqem.3310080107

DO - 10.1002/tqem.3310080107

M3 - Article

AN - SCOPUS:27844457320

SN - 1088-1913

JO - Environmental Quality Management

JF - Environmental Quality Management

SUGGESTED TOPICS
The Magazine
Newsletters
Managing Yourself
Managing Teams
Work-life Balance
The Big Idea
Data & Visuals
Reading Lists
Case Selections
HBR Learning
Topic Feeds
Account Settings
Email Preferences

Lessons from Honda’s Early Adaptive Strategy

Adam Richardson

My last post talked about how a little-known company, Grace Manufacturing, took a flexible and opportunistic approach to its strategy when its core business faltered. There are many parallels with this story and another from over 50 years ago when another then-little-known company, Honda, sought to expand its motorbike business into the U.S. We all […]

My last post talked about how a little-known company , Grace Manufacturing, took a flexible and opportunistic approach to its strategy when its core business faltered. There are many parallels with this story and another from over 50 years ago when another then-little-known company, Honda, sought to expand its motorbike business into the U.S.

Adam Richardson is a creative director at the global innovation firm frog design and the author of Innovation X: Why a Company’s Toughest Problems Are Its Greatest Advantage . His background combines experience in product development, product strategy, and customer research.

Partner Center

SCROLL TO SITE

SCROLL TO CURRENT LIST

Strategic Vision 2021 Quality Survey Puts Honda On Top

Honda was a big winner in the 2021 Strategic Vision Total Quality Impact (TQI) survey published today. Honda achieved top scores in five categories: small car (Honda Civic Coupe), small hatchback (Honda Civic Hatchback), small alternative powertrain, or APT (Honda Insight), mid-size APT (Honda Accord Hybrid) and minivan (Honda Odyssey) categories. Kia and Mercedes-Benz were each winners in three categories.

Porsche was the top-scoring brand overall (638), followed by BMW (636), Mini (628), Genesis (627) and Mercedes-Benz tied with Maserati (both 611). Other high-placing brands were Volvo and Lincoln (both 607), Tesla (598) and Cadillac (593).

The TQI survey, with results from 132,264 car owners, isn’t as well known as JD Power’s Initial Quality Study . But Strategic Vision claims TQI is “the automotive industry’s most complete measure of the quality of a new vehicle,” including both the state of the vehicle as delivered and “the quality of the experience of owning and driving it.” In that sense, it also combines elements seen in Power’s Automotive Performance, Execution and Layout ( APEAL ) study, which also asks new owners to assess their vehicles after living with them for 90 days.

What TQI Measures

For TQI, vehicles are evaluated on a 1,000-point scale that looks at—in addition to initial and overall perception of quality and satisfaction—such factors as emotional attachment, willingness to be an advocate for the brand, future purchase intentions for the brand, and overall sales and service experiences. Most vehicles score between 400 and 700, and scores over 600 are considered very good. The full list of scores isn’t reported publicly.

Alexander Edwards, president of Strategic Vision, told Forbes Wheels that Honda buyers come to the brand with a perception that Honda has better reliability and trust. “But it’s a double-edged sword,” he said, “because their positive perception can turn negative if the vehicle then has more problems than they expected. It’s then glaring, and it hurts more than it would have otherwise.”

Nonetheless, some consumers are so in love with the cars they buy that they sometimes overlook problems. Their perceived quality impression in this case isn’t much changed by their actual experience. For instance, Tesla has known reliability and fit-and-finish issues, but it was still number one in the Consumer Reports owner satisfaction data for 2020.

Tesla was not a winner in this year’s TQI results, though the Model 3 won near-luxury APT last year. For 2021, the Model 3 came in third in that class. The winning Volvo S60 Hybrid scored 650, the Lincoln MKZ Hybrid 627 and the Tesla 621. Of course, those are very close scores. “It’s not that Tesla is necessarily doing worse, but a few other models did exceptionally well,” Edwards said. In announcing the winners last year, he noted that buyers were apparently ignoring Tesla’s quality problems, but maybe that’s no longer the case.

Measured: Things Gone Wrong, Owner Perceptions

TQI measures both “things that go wrong” (TGW) per 100 vehicles and the percentage of owners reporting problems. That would seem to be objective information, regardless of whether owners have stars in their eyes. Edwards said the survey includes 130 attribute questions and 25 value questions that get into emotional responses, such as prestige and safety. “We measure what is delivered to customers, based on their priorities,” Edwards said. “How strongly do they feel about their vehicle, why do they feel that way, and are they likely to stay loyal to the brand. In other words, what’s important to them?”

He added that for some buyers, if the car has a problem—and it’s promptly and efficiently handled by the dealership—their perception of the car rises higher than it would have been with no issues.

Sample questions include, “How do you feel about your new vehicle ?” and “How likely are you in the future to purchase or lease another new vehicle made by the same brand?”

Edwards says TQI also considers the severity of problems: a loose screw isn’t as critical as an inoperative side mirror which isn’t as bad as a failed transmission.

Triple Winners: Kia, Mercedes-Benz

Kia won in three categories for 2021: near-luxury car (Stinger), entry CUV (Seltos) and mid-size CUV (Telluride). Corporate partner Hyundai placed only for mid-size SUV (Palisade). Subaru won in mid-size car (WRX), and Mercedes-Benz was a triple winner for luxury car (S-Class), near-luxury utility (GLC) and luxury SUV (G-Class). General Motors scored for heavy-duty pickup (Sierra 2500/3500) and full-size utility (Chevrolet Suburban).

Toyota (including Lexus) has a strong reputation for quality akin to Honda’s, but it didn’t do quite as well, winning for premium coupe (Lexus LC) and APT utility (RAV4 Prime). Some of these categories obviously matter more than others: Automakers today would rather top the CUV survey than premium coupe. As a brand, Toyota finished well below average, along with Mitsubishi and Volkswagen.

Top Brands by Price: Honda, Mini, Genesis, Lexus, Porsche

Ford did well with its new Bronco Sport, winning the entry CUV segment. It also won for standard convertible with its one remaining car, the Mustang. Jeep took the standard pickup category with the Gladiator, suggesting that it was a good idea for the brand to get back into the pickup market after 26 years. Jeep’s parent Stellantis also won for full-size pickup (Dodge Ram 1500).

Audi took the gold for luxury hatchback (A5/RS5 Sportback). BMW captured two categories, premium convertible/roadster (8-Series) and luxury CUV (X6).

Strategic Vision also broke down brands into price categories. The top brand under $32,000 was Honda, with a score of 558, followed by Mazda with 553 and Kia with 548. From $32,100 to $40,000, Mini was the winner with 628, followed by Dodge (581) and Chevrolet (558). From $40,000 to $52,000, Genesis was the top brand (627), followed by Volvo (607) and Lexus (591). Lexus was tied with Alfa-Romeo (also 591).

Getting into more rarefied air, Porsche (with its fanatical owners) is the unsurprising winner in the $52,100 to $99,000 category (638), followed by BMW (636) and Mercedes-Benz (611). Benz was tied with Maserati (also 611).

Toyota: Reliability, Durability; Not Always the Best Product

Among brands, the back of the pack for 2021 TQI includes Mitsubishi, Toyota and Volkswagen. “Toyota is a brand that stands for Reliability and Durability which puts Toyota models in the consumer’s purchase path (Initial Consideration) more often than most any other brand. However, when customers compare a Honda Accord and a Toyota Camry, they find that the Accord (and others) are better products and they walk away,” Edwards said in a statement to Forbes Wheels. “Toyota is (slightly) better in perceived quality as a brand, but it is the product that gives Honda the wins in Total Quality.”

As for VW, Edwards says, “The brand starts with strong imagery of Fun, Excitement and Youth. However, the brand suffers in believed Trust (the remnants of the Diesel issues are still there for some). Ultimately, this makes for a brand that rarely starts in a person’s Initial Consideration set (lack of Security, Reliability and Trust) and therefore, it doesn’t often find itself in the Final Consideration set.”

Sign up for the newsletter

Digital editions.

Total quality management: three case studies from around the world

With organisations to run and big orders to fill, it’s easy to see how some ceos inadvertently sacrifice quality for quantity. by integrating a system of total quality management it’s possible to have both.

Top 5 ways to manage the board during turbulent times Top 5 ways to create a family-friendly work culture Top 5 tips for a successful joint venture Top 5 ways managers can support ethnic minority workers Top 5 ways to encourage gender diversity in the workplace Top 5 ways CEOs can create an ethical company culture Top 5 tips for going into business with your spouse Top 5 ways to promote a healthy workforce Top 5 ways to survive a recession Top 5 tips for avoiding the ‘conference vortex’ Top 5 ways to maximise new parents’ work-life balance with technology Top 5 ways to build psychological safety in the workplace Top 5 ways to prepare your workforce for the AI revolution Top 5 ways to tackle innovation stress in the workplace Top 5 tips for recruiting Millennials

There are few boardrooms in the world whose inhabitants don’t salivate at the thought of engaging in a little aggressive expansion. After all, there’s little room in a contemporary, fast-paced business environment for any firm whose leaders don’t subscribe to ambitions of bigger factories, healthier accounts and stronger turnarounds. Yet too often such tales of excess go hand-in-hand with complaints of a severe drop in quality.

Food and entertainment markets are riddled with cautionary tales, but service sectors such as health and education aren’t immune to the disappointing by-products of unsustainable growth either. As always, the first steps in avoiding a catastrophic forsaking of quality begins with good management.

There are plenty of methods and models geared at managing the quality of a particular company’s goods or services. Yet very few of those models take into consideration the widely held belief that any company is only as strong as its weakest link. With that in mind, management consultant William Deming developed an entirely new set of methods with which to address quality.

Deming, whose managerial work revolutionised the titanic Japanese manufacturing industry, perceived quality management to be more of a philosophy than anything else. Top-to-bottom improvement, he reckoned, required uninterrupted participation of all key employees and stakeholders. Thus, the total quality management (TQM) approach was born.

All in Similar to the Six Sigma improvement process, TQM ensures long-term success by enforcing all-encompassing internal guidelines and process standards to reduce errors. By way of serious, in-depth auditing – as well as some well-orchestrated soul-searching – TQM ensures firms meet stakeholder needs and expectations efficiently and effectively, without forsaking ethical values.

By opting to reframe the way employees think about the company’s goals and processes, TQM allows CEOs to make sure certain things are done right from day one. According to Teresa Whitacre, of international consulting firm ASQ , proper quality management also boosts a company’s profitability.

“Total quality management allows the company to look at their management system as a whole entity — not just an output of the quality department,” she says. “Total quality means the organisation looks at all inputs, human resources, engineering, production, service, distribution, sales, finance, all functions, and their impact on the quality of all products or services of the organisation. TQM can improve a company’s processes and bottom line.”

Embracing the entire process sees companies strive to improve in several core areas, including: customer focus, total employee involvement, process-centred thinking, systematic approaches, good communication and leadership and integrated systems. Yet Whitacre is quick to point out that companies stand to gain very little from TQM unless they’re willing to go all-in.

“Companies need to consider the inputs of each department and determine which inputs relate to its governance system. Then, the company needs to look at the same inputs and determine if those inputs are yielding the desired results,” she says. “For example, ISO 9001 requires management reviews occur at least annually. Aside from minimum standard requirements, the company is free to review what they feel is best for them. While implementing TQM, they can add to their management review the most critical metrics for their business, such as customer complaints, returns, cost of products, and more.”

The customer knows best: AtlantiCare TQM isn’t an easy management strategy to introduce into a business; in fact, many attempts tend to fall flat. More often than not, it’s because firms maintain natural barriers to full involvement. Middle managers, for example, tend to complain their authority is being challenged when boots on the ground are encouraged to speak up in the early stages of TQM. Yet in a culture of constant quality enhancement, the views of any given workforce are invaluable.

AtlantiCare in numbers

5,000 Employees

$280m Profits before quality improvement strategy was implemented

$650m Profits after quality improvement strategy

One firm that’s proven the merit of TQM is New Jersey-based healthcare provider AtlantiCare . Managing 5,000 employees at 25 locations, AtlantiCare is a serious business that’s boasted a respectable turnaround for nearly two decades. Yet in order to increase that margin further still, managers wanted to implement improvements across the board. Because patient satisfaction is the single-most important aspect of the healthcare industry, engaging in a renewed campaign of TQM proved a natural fit. The firm chose to adopt a ‘plan-do-check-act’ cycle, revealing gaps in staff communication – which subsequently meant longer patient waiting times and more complaints. To tackle this, managers explored a sideways method of internal communications. Instead of information trickling down from top-to-bottom, all of the company’s employees were given freedom to provide vital feedback at each and every level.

AtlantiCare decided to ensure all new employees understood this quality culture from the onset. At orientation, staff now receive a crash course in the company’s performance excellence framework – a management system that organises the firm’s processes into five key areas: quality, customer service, people and workplace, growth and financial performance. As employees rise through the ranks, this emphasis on improvement follows, so managers can operate within the company’s tight-loose-tight process management style.

After creating benchmark goals for employees to achieve at all levels – including better engagement at the point of delivery, increasing clinical communication and identifying and prioritising service opportunities – AtlantiCare was able to thrive. The number of repeat customers at the firm tripled, and its market share hit a six-year high. Profits unsurprisingly followed. The firm’s revenues shot up from $280m to $650m after implementing the quality improvement strategies, and the number of patients being serviced dwarfed state numbers.

Hitting the right notes: Santa Cruz Guitar Co For companies further removed from the long-term satisfaction of customers, it’s easier to let quality control slide. Yet there are plenty of ways in which growing manufacturers can pursue both quality and sales volumes simultaneously. Artisan instrument makers the Santa Cruz Guitar Co (SCGC) prove a salient example. Although the California-based company is still a small-scale manufacturing operation, SCGC has grown in recent years from a basement operation to a serious business.

SCGC in numbers

14 Craftsmen employed by SCGC

800 Custom guitars produced each year

Owner Dan Roberts now employs 14 expert craftsmen, who create over 800 custom guitars each year. In order to ensure the continued quality of his instruments, Roberts has created an environment that improves with each sale. To keep things efficient (as TQM must), the shop floor is divided into six workstations in which guitars are partially assembled and then moved to the next station. Each bench is manned by a senior craftsman, and no guitar leaves that builder’s station until he is 100 percent happy with its quality. This product quality is akin to a traditional assembly line; however, unlike a traditional, top-to-bottom factory, Roberts is intimately involved in all phases of instrument construction.

Utilising this doting method of quality management, it’s difficult to see how customers wouldn’t be satisfied with the artists’ work. Yet even if there were issues, Roberts and other senior management also spend much of their days personally answering web queries about the instruments. According to the managers, customers tend to be pleasantly surprised to find the company’s senior leaders are the ones answering their technical questions and concerns. While Roberts has no intentions of taking his manufacturing company to industrial heights, the quality of his instruments and high levels of customer satisfaction speak for themselves; the company currently boasts one lengthy backlog of orders.

A quality education: Ramaiah Institute of Management Studies Although it may appear easier to find success with TQM at a boutique-sized endeavour, the philosophy’s principles hold true in virtually every sector. Educational institutions, for example, have utilised quality management in much the same way – albeit to tackle decidedly different problems.

The global financial crisis hit higher education harder than many might have expected, and nowhere have the odds stacked higher than in India. The nation plays home to one of the world’s fastest-growing markets for business education. Yet over recent years, the relevance of business education in India has come into question. A report by one recruiter recently asserted just one in four Indian MBAs were adequately prepared for the business world.

RIMS in numbers

9% Increase in test scores post total quality management strategy

22% Increase in number of recruiters hiring from the school

20,000 Increase in the salary offered to graduates

50,000 Rise in placement revenue

At the Ramaiah Institute of Management Studies (RIMS) in Bangalore, recruiters and accreditation bodies specifically called into question the quality of students’ educations. Although the relatively small school has always struggled to compete with India’s renowned Xavier Labour Research Institute, the faculty finally began to notice clear hindrances in the success of graduates. The RIMS board decided it was time for a serious reassessment of quality management.

The school nominated Chief Academic Advisor Dr Krishnamurthy to head a volunteer team that would audit, analyse and implement process changes that would improve quality throughout (all in a particularly academic fashion). The team was tasked with looking at three key dimensions: assurance of learning, research and productivity, and quality of placements. Each member underwent extensive training to learn about action plans, quality auditing skills and continuous improvement tools – such as the ‘plan-do-study-act’ cycle.

Once faculty members were trained, the team’s first task was to identify the school’s key stakeholders, processes and their importance at the institute. Unsurprisingly, the most vital processes were identified as student intake, research, knowledge dissemination, outcomes evaluation and recruiter acceptance. From there, Krishnamurthy’s team used a fishbone diagram to help identify potential root causes of the issues plaguing these vital processes. To illustrate just how bad things were at the school, the team selected control groups and administered domain-based knowledge tests.

The deficits were disappointing. A RIMS students’ knowledge base was rated at just 36 percent, while students at Harvard rated 95 percent. Likewise, students’ critical thinking abilities rated nine percent, versus 93 percent at MIT. Worse yet, the mean salaries of graduating students averaged $36,000, versus $150,000 for students from Kellogg. Krishnamurthy’s team had their work cut out.

To tackle these issues, Krishnamurthy created an employability team, developed strategic architecture and designed pilot studies to improve the school’s curriculum and make it more competitive. In order to do so, he needed absolutely every employee and student on board – and there was some resistance at the onset. Yet the educator asserted it didn’t actually take long to convince the school’s stakeholders the changes were extremely beneficial.

“Once students started seeing the results, buy-in became complete and unconditional,” he says. Acceptance was also achieved by maintaining clearer levels of communication with stakeholders. The school actually started to provide shareholders with detailed plans and projections. Then, it proceeded with a variety of new methods, such as incorporating case studies into the curriculum, which increased general test scores by almost 10 percent. Administrators also introduced a mandate saying students must be certified in English by the British Council – increasing scores from 42 percent to 51 percent.

By improving those test scores, the perceived quality of RIMS skyrocketed. The number of top 100 businesses recruiting from the school shot up by 22 percent, while the average salary offers graduates were receiving increased by $20,000. Placement revenue rose by an impressive $50,000, and RIMS has since skyrocketed up domestic and international education tables.

No matter the business, total quality management can and will work. Yet this philosophical take on quality control will only impact firms that are in it for the long haul. Every employee must be in tune with the company’s ideologies and desires to improve, and customer satisfaction must reign supreme.

Contributors

Industry Outlook

Academia.edu no longer supports Internet Explorer.

To browse Academia.edu and the wider internet faster and more securely, please take a few seconds to upgrade your browser .

Enter the email address you signed up with and we'll email you a reset link.

We're Hiring!
Help Center

Total Quality Management Approaches Honda Vs Ford.docx

Related Papers

José Carlos Sá

The purpose of this study is to analyze the impact of Six Sigma and TQM approaches inside organizations and if they are being used appropriately in order to support their future challenges. Organizations today are faced with ongoing challenges to their ability to continue to provide positive results to its shareholders so that it is possible to anticipate the needs of their customers. We aim to understand whether there is added value for the companies that are using both methodologies.

mahender pal

everything needs to be quality checked

Publisher ijmra.us UGC Approved

FAISAL TALIB

management research field. It is one of the most applied and well accepted approaches for business excellence besides Continuous Quality Improvement (CQI), Six Sigma, Just-in-Time (JIT), and Supply Chain Management (SCM) approaches. There is a great enthusiasm among manufacturing and service industries in adopting and implementing this strategy in order to maintain their sustainable competitive advantage. The aim of this study is to develop and propose the conceptual framework and research model of TQM implementation in relation to company performance particularly in context with the Indian service companies. It examines the relationships between TQM and company’s performance by measuring the quality performance as performance indicator. A comprehensive review of literature on TQM and quality performance was carried out to accomplish the objectives of this study and a research model and hypotheses were generated. Two research questions and 34 hypotheses were proposed to re-validate the TQM practices. The adoption of such a theoretical model on TQM and company’s quality performance would help managers, decision makers, and practitioners of TQM in better understanding of the TQM practices and to focus on the identified practices while implementing TQM in their companies. Further, the scope for future study is to test and validate the theoretical model by collecting the primary data from the Indian service companies and using Structural Equation Modeling (SEM) approach for hypotheses testing.

abolfazl tahmasebi

The TQM Journal

Jiju Antony

jiju1968 antony

Susan Helper

RELATED PAPERS

Chetan Darwatkar

Bone Marrow Transplantation

Edoardo Lanino

Acta Chemica Scandinavica

Priscilla Meyer

IEEE Transactions on Antennas and Propagation

Luca Manica

Journal of Landscape Ecology

Martin Neruda

Blood transfusion = Trasfusione del sangue

Emanuela Midolo

ChemCatChem

Khalid Majnouni

Journal of Poverty and Social Justice

Peter Whiteford

Karina Kato

Luis Augusto Hernández

Collabra: Psychology

Luca M . Leisten

Gloria Fiorentini

Edward Harris

Mağallaẗ Taṭbīqat ʿulūm al-riyāḍaẗ

Shady Alhenawy

Frontiers in Genetics

Namrata Tomar, Ph. D.

Journal of Crohn's and Colitis Supplements

Derek Jewell

Matthew Akester

RAZIDA HANEM MOHD RADZIL

Defence Life Science Journal

Dr.Anand Katiyar

Edward Bormashenko

Fatores de virulência microbianos e terapias emergentes (Vol. 1)

MARIA BETANIA MELO DE OLIVEIRA

hjfgffg hkjyt

Search Case Studies

Case details, case categories.

Business Environment Business Ethics Business Reports Business Strategy Corporate Governance Economics Enterprise Risk Management Finance HRM Innovation Insurance IT and Systems Leadership & Entrepreneurship Marketing Miscellaneous Operations Project Management Sustainability Women Empowerment Family Business Management

Design & Quality Concerns at Honda Motors

The case is structured to achieve the following teaching objectives:

To determine a company's responsibility toward its customers in maintaining the quality of its products.
Understand how design and quality issues can damage the company’s corporate image and its brand.
Discuss Honda Motors’ initiatives to maintain its fundamental approach to quality as well as improving the design of its future products.
Analyze the challenges Honda Motors could face while trying to tackle design and quality issues in its products and maintain its brand image.
Explore ways in which Honda Motors could overcome its quality and design issues.

Design,Quality,Operations management,Engineering,Product portfolio,Corporate image,Brand image,Innovation,Quality issues,Product recall,Quality Cycle,Quality enhancement systems

Research article
Open access
Published: 15 April 2024

What is quality in long covid care? Lessons from a national quality improvement collaborative and multi-site ethnography

Trisha Greenhalgh ORCID: orcid.org/0000-0003-2369-8088 1 ,
Julie L. Darbyshire 1 ,
Cassie Lee 2 ,
Emma Ladds 1 &
Jenny Ceolta-Smith 3

BMC Medicine volume 22 , Article number: 159 ( 2024 ) Cite this article

1263 Accesses

59 Altmetric

Metrics details

Long covid (post covid-19 condition) is a complex condition with diverse manifestations, uncertain prognosis and wide variation in current approaches to management. There have been calls for formal quality standards to reduce a so-called “postcode lottery” of care. The original aim of this study—to examine the nature of quality in long covid care and reduce unwarranted variation in services—evolved to focus on examining the reasons why standardizing care was so challenging in this condition.

In 2021–2023, we ran a quality improvement collaborative across 10 UK sites. The dataset reported here was mostly but not entirely qualitative. It included data on the origins and current context of each clinic, interviews with staff and patients, and ethnographic observations at 13 clinics (50 consultations) and 45 multidisciplinary team (MDT) meetings (244 patient cases). Data collection and analysis were informed by relevant lenses from clinical care (e.g. evidence-based guidelines), improvement science (e.g. quality improvement cycles) and philosophy of knowledge.

Participating clinics made progress towards standardizing assessment and management in some topics; some variation remained but this could usually be explained. Clinics had different histories and path dependencies, occupied a different place in their healthcare ecosystem and served a varied caseload including a high proportion of patients with comorbidities. A key mechanism for achieving high-quality long covid care was when local MDTs deliberated on unusual, complex or challenging cases for which evidence-based guidelines provided no easy answers. In such cases, collective learning occurred through idiographic (case-based) reasoning , in which practitioners build lessons from the particular to the general. This contrasts with the nomothetic reasoning implicit in evidence-based guidelines, in which reasoning is assumed to go from the general (e.g. findings of clinical trials) to the particular (management of individual patients).

Not all variation in long covid services is unwarranted. Largely because long covid’s manifestations are so varied and comorbidities common, generic “evidence-based” standards require much individual adaptation. In this complex condition, quality improvement resources may be productively spent supporting MDTs to optimise their case-based learning through interdisciplinary discussion. Quality assessment of a long covid service should include review of a sample of individual cases to assess how guidelines have been interpreted and personalized to meet patients’ unique needs.

Study registration

NCT05057260, ISRCTN15022307.

Peer Review reports

The term “long covid” [ 1 ] means prolonged symptoms following SARS-CoV-2 infection not explained by an alternative diagnosis [ 2 ]. It embraces the US term “post-covid conditions” (symptoms beyond 4 weeks) [ 3 ], the UK terms “ongoing symptomatic covid-19” (symptoms lasting 4–12 weeks) and “post covid-19 syndrome” (symptoms beyond 12 weeks) [ 4 ] and the World Health Organization’s “post covid-19 condition” (symptoms occurring beyond 3 months and persisting for at least 2 months) [ 5 ]. Long covid thus defined is extremely common. In UK, for example, 1.8 million of a population of 67 million met the criteria for long covid in early 2023 and 41% of these had been unwell for more than 2 years [ 6 ].

Long covid is characterized by a constellation of symptoms which may include breathlessness, fatigue, muscle and joint pain, chest pain, memory loss and impaired concentration (“brain fog”), sleep disturbance, depression, anxiety, palpitations, dizziness, gastrointestinal problems such as diarrhea, skin rashes and allergy to food or drugs [ 2 ]. These lead to difficulties with essential daily activities such as washing and dressing, impaired exercise tolerance and ability to work, and reduced quality of life [ 2 , 7 , 8 ]. Symptoms typically cluster (e.g. in different patients, long covid may be dominated by fatigue, by breathlessness or by palpitations and dizziness) [ 9 , 10 ]. Long covid may follow a fairly constant course or a relapsing and remitting one, perhaps with specific triggers [ 11 ]. Overlaps between fatigue-dominant subtypes of long covid, myalgic encephalomyelitis and chronic fatigue syndrome have been hypothesized [ 12 ] but at the time of writing remain unproven.

Long covid has been a contested condition from the outset. Whilst long-term sequelae following other coronavirus (SARS and MERS) infections were already well-documented [ 13 ], SARS-CoV-2 was originally thought to cause a short-lived respiratory illness from which the patient either died or recovered [ 14 ]. Some clinicians dismissed protracted or relapsing symptoms as due to anxiety or deconditioning, especially if the patient had not had laboratory-confirmed covid-19. People with long covid got together in online groups and shared accounts of their symptoms and experiences of such “gaslighting” in their healthcare encounters [ 15 , 16 ]. Some groups conducted surveys on their members, documenting the wide range of symptoms listed in the previous paragraph and showing that whilst long covid is more commonly a sequel to severe acute covid-19, it can (rarely) follow a mild or even asymptomatic acute infection [ 17 ].

Early publications on long covid depicted a post-pneumonia syndrome which primarily affected patients who had been hospitalized (and sometimes ventilated) [ 18 , 19 ]. Later, covid-19 was recognized to be a multi-organ inflammatory condition (the pneumonia, for example, was reclassified as pneumonitis ) and its long-term sequelae attributed to a combination of viral persistence, dysregulated immune response (including auto-immunity), endothelial dysfunction and immuno-thrombosis, leading to damage to the lining of small blood vessels and (thence) interference with transfer of oxygen and nutrients to vital organs [ 20 , 21 , 22 , 23 , 24 ]. But most such studies were highly specialized, laboratory-based and written primarily for an audience of fellow laboratory researchers. Despite demonstrating mean differences in a number of metabolic variables, they failed to identify a reliable biomarker that could be used routinely in the clinic to rule a diagnosis of long covid in or out. Whilst the evidence base from laboratory studies grew rapidly, it had little influence on clinical management—partly because most long covid clinics had been set up with impressive speed by front-line clinical teams to address an immediate crisis, with little or no input from immunologists, virologists or metabolic specialists [ 25 ].

Studies of the patient experience revealed wide geographical variation in whether any long covid services were provided and (if they were) which patients were eligible for these and what tests and treatments were available [ 26 ]. An interim UK clinical guideline for long covid had been produced at speed and published in December 2020 [ 27 ], but it was uncertain about diagnostic criteria, investigations, treatments and prognosis. Early policy recommendations for long covid services in England, based on wide consultation across UK, had proposed a tiered service with “tier 1” being supported self-management, “tier 2” generalist assessment and management in primary care, “tier 3” specialist rehabilitation or respiratory follow-up with oversight from a consultant physician and “tier 4” tertiary care for patients with complications or complex needs [ 28 ]. In 2021, ring-fenced funding was allocated to establish 90 multidisciplinary long covid clinics in England [ 29 ]; some clinics were also set up with local funding in Scotland and Wales. These clinics varied widely in eligibility criteria, referral pathways, staffing mix (some had no doctors at all) and investigations and treatments offered. A further policy document on improving long covid services was published in 2022 [ 30 ]; it recommended that specialist long covid clinics should continue, though the long-term funding of these services remains uncertain [ 31 ]. To build the evidence base for delivering long covid services, major programs of publicly funded research were commenced in both UK [ 32 ] and USA [ 33 ].

In short, at the time this study began (late 2021), there appeared to be much scope for a program of quality improvement which would capture fast-emerging research findings, establish evidence-based standards and ensure these were rapidly disseminated and consistently adopted across both specialist long covid services and in primary care.

Quality improvement collaboratives

The quality improvement movement in healthcare was born in the early 1980s when clinicians and policymakers US and UK [ 34 , 35 , 36 , 37 ] began to draw on insights from outside the sector [ 38 , 39 , 40 ]. Adapting a total quality management approach that had previously transformed the Japanese car industry, they sought to improve efficiency, reduce waste, shift to treating the upstream causes of problems (hence preventing disease) and help all services approach the standards of excellence achieved by the best. They developed an approach based on (a) understanding healthcare as a complex system (especially its key interdependencies and workflows), (b) analysing and addressing variation within the system, (c) learning continuously from real-world data and (d) developing leaders who could motivate people and help them change structures and processes [ 41 , 42 , 43 , 44 ].

Quality improvement collaboratives (originally termed “breakthrough collaboratives” [ 45 ]), in which representatives from different healthcare organizations come together to address a common problem, identify best practice, set goals, share data and initiate and evaluate improvement efforts [ 46 ], are one model used to deliver system-wide quality improvement. It is widely assumed that these collaboratives work because—and to the extent that—they identify, interpret and implement high-quality evidence (e.g. from randomized controlled trials).

Research on why quality improvement collaboratives succeed or fail has produced the following list of critical success factors: taking a whole-system approach, selecting a topic and goal that fits with organizations’ priorities, fostering a culture of quality improvement (e.g. that quality is everyone’s job), engagement of everyone (including the multidisciplinary clinical team, managers, patients and families) in the improvement effort, clearly defining people’s roles and contribution, engaging people in preliminary groundwork, providing organizational-level support (e.g. chief executive endorsement, protected staff time, training and support for teams, resources, quality-focused human resource practices, external facilitation if needed), training in specific quality improvement techniques (e.g. plan-do-study-act cycle), attending to the human dimension (including cultivating trust and working to ensure shared vision and buy-in), continuously generating reliable data on both processes (e.g. current practice) and outcomes (clinical, satisfaction) and a “learning system” infrastructure in which knowledge that is generated feeds into individual, team and organizational learning [ 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 ].

The quality improvement collaborative approach has delivered many successes but it has been criticized at a theoretical level for over-simplifying the social science of human motivation and behaviour and for adopting a somewhat mechanical approach to the study of complex systems [ 55 , 56 ]. Adaptations of the original quality improvement methodology (e.g. from Sweden [ 57 , 58 ]) have placed greater emphasis on human values and meaning-making, on the grounds that reducing the complexities of a system-wide quality improvement effort to a set of abstract and generic “success factors” will miss unique aspects of the case such as historical path dependencies, personalities, framing and meaning-making and micropolitics [ 59 ].

Perhaps this explains why, when the abovementioned factors are met, a quality improvement collaborative’s success is more likely but is not guaranteed, as a systematic review demonstrated [ 60 ]. Some well-designed and well-resourced collaboratives addressing clear knowledge gaps produced few or no sustained changes in key outcome measures [ 49 , 53 , 60 , 61 , 62 ]. To identify why this might be, a detailed understanding of a service’s history, current challenges and contextual constraints is needed. This explains our decision, part-way through the study reported here, to collect rich contextual data on participating sites so as to better explain success or failure of our own collaborative.

Warranted and unwarranted variation in clinical practice

A generation ago, Wennberg described most variation in clinical practice as “unwarranted” (which he defined as variation in the utilization of health care services that cannot be explained by variation in patient illness or patient preferences) [ 63 ]. Others coined the term “postcode lottery” to depict how such variation allegedly impacted on health outcomes [ 64 ]. Wennberg and colleagues’ Atlas of Variation , introduced in 1999 [ 65 ], and its UK equivalent, introduced in 2010 [ 66 ], described wide regional differences in the rates of procedures from arthroscopy to hysterectomy, and were used to prompt services to identify and address examples of under-treatment, mis-treatment and over-treatment. Numerous similar initiatives, mostly based on hospital activity statistics, have been introduced around the world [ 66 , 67 , 68 , 69 ]. Sutherland and Levesque’s proposed framework for analysing variation, for example, has three domains: capacity (broadly, whether sufficient resources are allocated at organizational level and whether individuals have the time and headspace to get involved), evidence (the extent to which evidence-based guidelines exist and are followed), and agency (e.g. whether clinicians are engaged with the issue and the effect of patient choice) [ 70 ].

Whilst it is clearly a good idea to identify unwarranted variation in practice, it is also important to acknowledge that variation can be warranted . The very act of measuring and describing variation carries great rhetorical power, since revealing geographical variation in any chosen metric effectively frames this as a problem with a conceptually simple solution (reducing variation) that will appeal to both politicians and the public [ 71 ]. The temptation to expose variation (e.g. via visualizations such as maps) and address it in mechanistic ways should be resisted until we have fully understood the reasons why it exists, which may include perverse incentives, insufficient opportunities to discuss cases with colleagues, weak or absent feedback on practice, unclear decision processes, contested definitions of appropriate care and professional challenges to guidelines [ 72 ].

Research question, aims and objectives

Research question.

What is quality in long covid care and how can it best be achieved?

To identify best practice and reduce unwarranted variation in UK long covid services.

To explain aspects of variation in long covid services that are or may be warranted.

Our original objectives were to:

Establish a quality improvement collaborative for 10 long covid clinics across UK.

Use quality improvement methods in collaboration with patients and clinic staff to prioritize aspects of care to improve. For each priority topic, identify best (evidence-informed) clinical practice, measure performance in each clinic, compare performance with a best practice benchmark and improve performance.

Produce organizational case studies of participating long covid clinics to explain their origins, evolution, leadership, ethos, population served, patient pathways and place in the wider healthcare ecosystem.

Examine these case studies to explain variation in practice, especially in topics where the quality improvement cycle proves difficult to follow or has limited impact.

The LOCOMOTION study

LOCOMOTION (LOng COvid Multidisciplinary consortium Optimising Treatments and services across the NHS) was a 30-month multi-site case study of 10 long covid clinics (8 in England, 1 in Wales and 1 in Scotland), beginning in 2021, which sought to optimise long covid care. Each clinic offered multidisciplinary care to patients referred from primary or secondary care (and, in some cases, self-referred), and held regular multidisciplinary team (MDT) meetings, mostly online via Microsoft Teams, to discuss cases. A study protocol for LOCOMOTION, with details of ethical approvals, management, governance and patient involvement has been published [ 25 ]. The three main work packages addressed quality improvement, technology-supported patient self-management and phenotyping and symptom clustering. This paper reports on the first work package, focusing mainly on qualitative findings.

Setting up the quality improvement collaborative

We broadly followed standard methodology for “breakthrough” quality improvement collaboratives [ 44 , 45 ], with two exceptions. First, because of geographical distance, continuing pandemic precautions and developments in videoconferencing technology, meetings were held online. Second, unlike in the original breakthrough model, patients were included in the collaborative, reflecting the cultural change towards patient partnerships since the model was originally proposed 40 years ago.

Each site appointed a clinical research fellow (doctor, nurse or allied health professional) funded partly by the LOCOMOTION study and partly with clinical sessions; some were existing staff who were backfilled to take on a research role whilst others were new appointments. The quality improvement meetings were held approximately every 8 weeks on Microsoft Teams and lasted about 2 h; there was an agenda and a chair, and meetings were recorded with consent. The clinical research fellow from each clinic attended, sometimes joined by the clinical lead for that site. In the initial meeting, the group proposed and prioritized topics before merging their consensus with the list of priority topics generated separately by patients (there was much overlap but also some differences).

In subsequent meetings, participants attempted to reach consensus on how to define, measure and achieve quality for each priority topic in turn, implement this approach in their own clinic and monitor its impact. Clinical leads prepared illustrative clinical cases and summaries of the research evidence, which they presented using Microsoft Powerpoint; the group then worked towards consensus on the implications for practice through general discussion. Clinical research fellows assisted with literature searches, collected baseline data from their own clinic, prepared and presented anonymized case examples, and contributed to collaborative goal-setting for improvement. Progress on each topic was reviewed at a later meeting after an agreed interval.

An additional element of this work package was semi-structured interviews with 29 patients, recruited from 9 of the 10 participating sites, about their clinic experiences with a view to feeding into service improvement (in the other site, no patient volunteered).

Our patient advisory group initially met separately from the quality improvement collaborative. They designed a short survey of current practice and sent it to each clinic; the results of this informed a prioritization exercise for topics where they considered change was needed. The patient-generated list was tabled at the quality improvement collaborative discussions, but patients were understandably keen to join these discussions directly. After about 9 months, some patient advisory group members joined the regular collaborative meetings. This dynamic was not without its tensions, since sharing performance data requires trust and there were some concerns about confidentiality when real patient cases were discussed with other patients present.

How evidence-informed quality targets were set

At the time the study began, there were no published large-scale randomized controlled trials of any interventions for long covid. We therefore followed a model used successfully in other quality improvement efforts where research evidence was limited or absent or it did not translate unambiguously into models for current services. In such circumstances, the best evidence may be custom and practice in the best-performing units. The quality improvement effort becomes oriented to what one group of researchers called “potentially better practices”—that is, practices that are “developed through analysis of the processes of care, literature review, and site visits” (page 14) [ 73 ]. The idea was that facilitated discussion among clinical teams, drawing on published research where available but also incorporating clinical experience, established practice and systematic analysis of performance data across participating clinics would surface these “potentially better practices”—an approach which, though not formally tested in controlled trials, appears to be associated with improved outcomes [ 46 , 73 ].

Adding an ethnographic component

Following limited progress made on some topics that had been designated high priority, we interviewed all 10 clinical research fellows (either individually or, in two cases, with a senior clinician present) and 18 other clinic staff (five individually plus two groups of 5 and 8), along with additional informal discussions, to explore the challenges of implementing the changes that had been agreed. These interviews were not audiotaped but detailed notes were made and typed up immediately afterwards. It became evident that some aspects of what the collaborative had deemed “evidence-informed” care were contested by front-line clinic staff, perceived as irrelevant to the service they were delivering, or considered impossible to implement. To unpack these issues further, the research protocol was amended to include an ethnographic component.

TG and EL (academic general practitioners) and JLD (a qualitative researcher with a PhD in the patient experience) attended a total of 45 MDT meetings in participating clinics (mostly online or hybrid). Staff were informed in advance that there would be an observer present; nobody objected. We noted brief demographic and clinical details of cases discussed (but no identifying data), dilemmas and uncertainties on which discussions focused, and how different staff members contributed.

TG made 13 in-person visits to participating long covid clinics. Staff were notified in advance; all were happy to be observed. Visits lasted between 5 and 8 h (54 h in total). We observed support staff booking patients in and processing requests and referrals, and shadowed different clinical staff in turn as they saw patients. Patients were informed of our presence and its purpose beforehand and given the opportunity to decline (three of 53 patients approached did). We discussed aspects of each case with the clinician after the patient left. When invited, we took breaks with staff and used these as an opportunity to ask them informally what it was like working in the clinic.

Ethnographic observation, analysis and reporting was geared to generating a rich interpretive account of the clinical, operational and interpersonal features of each clinic—what Van Maanen calls an “impressionist tales” [ 74 ]. Our work was also guided by the principles set out by Golden-Biddle and Locke, namely authenticity (spending time in the field and basing interpretations on these direct observations), plausibility (creating a plausible account through rich persuasive description) and criticality (e.g. reflexively examining our own assumptions) [ 75 ]. Our collection and analysis of qualitative data was informed by our own professional backgrounds (two general practitioners, one physical therapist, two non-clinicians).

In both MDTs and clinics, we took contemporaneous notes by hand and typed these up immediately afterwards.

Data management and analysis

Typed interview notes and field notes from clinics were collated in a set of Word documents, one for each clinic attended. They were analysed thematically [ 76 ] with attention to the literature on quality improvement and variation (see “ Background ”). Interim summaries were prepared on each clinic, setting out the narrative of how it had been established, its ethos and leadership, setting and staffing, population served and key links with other parts of the local healthcare ecosystem.

Minutes and field notes from the quality improvement collaborative meetings were summarized topic by topic, including initial data collected by the researchers-in-residence, improvement actions taken (or attempted) in that clinic, and any follow-up data shared. Progress or lack of it was interpreted in relation to the contextual case summary for that clinic.

Patient cases seen in clinic, and those discussed by MDTs, were summarized as brief case narratives in Word documents. Using the constant comparative method [ 77 ], we produced an initial synthesis of the clinical picture and principles of management based on the first 10 patient cases seen, and refined this as each additional case was added. Demographic and brief clinical and social details were also logged on Excel spreadsheets. When writing up clinical cases, we used the technique of composite case construction (in which we drew on several actual cases to generate a fictitious one, thereby protecting anonymity whilst preserving key empirical findings [ 78 ]); any names reported in this paper are pseudonyms.

Member checking

A summary was prepared for each clinic, including a narrative of the clinic’s own history and a summary of key quality issues raised across the ten clinics. These summaries included examples from real cases in our dataset. These were shared with the clinical research fellow and a senior clinician from the clinic, and amended in response to feedback. We also shared these summaries with representatives from the patient advisory group.

Overview of dataset

This study generated three complementary datasets. First, the video recordings, minutes, and field notes of 12 quality improvement collaborative meetings, along with the evidence summaries prepared for these meetings and clinic summaries (e.g. descriptions of current practice, audits) submitted by the clinical research fellows. This dataset illustrated wide variation in practice, and (in many topics) gaps or ambiguities in the evidence base.

Second, interviews with staff ( n = 30) and patients ( n = 29) from the clinics, along with ethnographic field notes (approximately 100 pages) from 13 in-person clinic visits (54 h), including notes on 50 patient consultations (40 face-to-face, 6 telephone, 4 video). This dataset illustrated the heterogeneity among the ten participating clinics.

Third, field notes (approximately 100 pages), including discussions on 244 clinical cases from the 45 MDT meetings (49 h) that we observed. This dataset revealed further similarities and contrasts among clinics in how patients were managed. In particular, it illustrated how, for the complex patients whose cases were presented at these meetings, teams made sense of, and planned for, each case through multidisciplinary dialogue. This dialogue typically began with one staff member presenting a detailed clinical history along with a narrative of how it had affected the patient’s life and what was at stake for them (e.g. job loss), after which professionals from various backgrounds (nursing, physical therapy, occupational therapy, psychology, dietetics, and different medical specialties) joined in a discussion about what to do.

The ten participating sites are summarized in Table 1 .

In the next two sections, we explore two issues—difficulty defining best practice and the heterogeneous nature of the clinics—that were key to explaining why quality, when pursued in a 10-site collaborative, proved elusive. We then briefly summarize patients’ accounts of their experience in the clinics and give three illustrative examples of the elusiveness of quality improvement using selected topics that were prioritized in our collaborative: outcome measures, investigation of palpitations and management of fatigue. In the final section of the results, we describe how MDT deliberations proved crucial for local quality improvement. Further detail on clinical priority topics will be presented in a separate paper.

“Best practice” in long covid: uncertainty and conflict

The study period (September 2021 to December 2023) corresponded with an exponential increase in published research on long covid. Despite this, the quality improvement collaborative found few unambiguous recommendations for practice. This gap between what the research literature offered and what clinical practice needed was partly ontological (relating what long covid is ). One major bone of contention between patients and clinicians (also evident in discussions with our patient advisory group), for example, was how far (and in whom) clinicians should look for and attempt to treat the various metabolic abnormalities that had been documented in laboratory research studies. The literature on this topic was extensive but conflicting [ 20 , 21 , 22 , 23 , 24 , 79 , 80 , 81 , 82 ]; it was heavy on biological detail but light on clinical application.

Patients were often aware of particular studies that appeared to offer plausible molecular or cellular explanations for symptom clusters along with a drug (often repurposed and off-label) whose mechanism of action appeared to be a good fit with the metabolic chain of causation. In one clinic, for example, we were shown an email exchange between a patient (not medically qualified) and a consultant, in which the patient asked them to reconsider their decision not to prescribe low-dose naltrexone, an opioid receptor antagonist with anti-inflammatory properties. The request included a copy of a peer-reviewed academic paper describing a small, uncontrolled pre-post study (i.e. a weak study design) in which this drug appeared to improve symptoms and functional performance in patients with long covid, as well as a mechanistic argument explaining why the patient felt this drug was a plausible choice in their own case.

This patient’s clinician, in common with most clinicians delivering front-line long covid services, considered that the evidence for such mechanism-based therapies was weak. Clinicians generally felt that this evidence, whilst promising, did not yet support routine measurement of clotting factors, antibodies, immune cells or other biomarkers or the prescription of mechanism-based therapies such as antivirals, anti-inflammatories or anticoagulants. Low-dose naltroxone, for example, is currently being tested in at least one randomized controlled trial (see National Clinical Trials Registry NCT05430152), which had not reported at the time of our observations.

Another challenge to defining best practice was the oft-repeated phrase that long covid is a “diagnosis by exclusion”, but the high prevalence of comorbidities meant that the “pure” long covid patient untainted by other potential explanations for their symptoms was a textbook ideal. In one MDT, for example, we observed a discussion about a patient who had had both swab-positive covid-19 and erythema migrans (a sign of Lyme disease) in the weeks before developing fatigue, yet local diagnostic criteria for each condition required the other to be excluded.

The logic of management in most participating clinics was pragmatic: prompt multidisciplinary assessment and treatment with an emphasis on obtaining a detailed clinical history (including premorbid health status), excluding serious complications (“red flags”), managing specific symptom clusters (for example, physical therapy for breathing pattern disorder), treating comorbidities (for example, anaemia, diabetes or menopause) and supporting whole-person rehabilitation [ 7 , 83 ]. The evidentiary questions raised in MDT discussions (which did not include patients) addressed the practicalities of the rehabilitation model (for example, whether cognitive therapy for neurocognitive complications is as effective when delivered online as it is when delivered in-person) rather than the molecular or cellular mechanisms of disease. For example, the question of whether patients with neurocognitive impairment should be tested for micro-clots or treated with anticoagulants never came up in the MDTs we observed, though we did visit a tertiary referral clinic (the tier 4 clinic in site H), whose lead clinician had a research interest in inflammatory coagulopathies and offered such tests to selected patients.

Because long covid typically produces dozens of symptoms that tend to be uniquely patterned in each patient, the uncertainties on which MDT discussions turned were rarely about general evidence of the kind that might be found in a guideline (e.g. how should fatigue be managed?). Rather they concerned particular case-based clinical decisions (e.g. how should this patient’s fatigue be managed, given the specifics of this case?). An example from our field notes illustrates this:

Physical therapist presents the case of a 39-year-old woman who works as a cleaner on an overnight ferry. Has had long covid for 2 years. Main symptoms are shortness of breath and possible anxiety attacks, especially when at work. She has had a course of physical therapy to teach diaphragmatic breathing but has found that focusing on her breathing makes her more anxious. Patient has to do a lot of bending in her job (e.g. cleaning toilets and under seats), which makes her dizzy, but Active Stand Test was normal. She also has very mild tricuspid incompetence [someone reads out a cardiology report—not hemodynamically significant].

Rehabilitation guidelines (e.g. WHO) recommend phased return to work (e.g. with reduced hours) and frequent breaks. “Tricky!” says someone. The job is intense and busy, and the patient can’t afford not to work. Discussion on whether all her symptoms can be attributed to tension and anxiety. Physical therapist who runs the breathing group says, “No, it’s long covid”, and describes severe initial covid-19 episode and results of serial chest X-rays which showed gradual clearing of ground glass shadows. Team discussion centers on how to negotiate reduced working hours in this particular job, given the overnight ferry shifts. --MDT discussion, Site D

This example raises important considerations about the nature of clinical knowledge in long covid. We return to it in the final section of the “ Results ” and in the “ Discussion ”.

Long covid clinics: a heterogeneous context for quality improvement

Most participating clinics had been established in mid-2020 to follow up patients who had been hospitalized (and perhaps ventilated) for severe acute covid-19. As mass vaccination reduced the severity of acute covid-19 for most people, the patient population in all clinics progressively shifted to include fewer “post-ICU [intensive care unit]” patients (in whom respiratory symptoms almost always dominated), and more people referred by their general practitioners or other secondary care specialties who had not been hospitalized for their acute covid-19 infection, and in whom fatigue, brain fog and palpitations were often the most troubling symptoms. Despite these similarities, the ten clinics had very different histories, geographical and material settings, staffing structures, patient pathways and case mix, as Table 1 illustrates. Below, we give more detail on three example sites.

Site C was established as a generalist “assessment-only” service by a general practitioner with an interest in infectious diseases. It is led jointly by that general practitioner and an occupational therapist, assisted by a wide range of other professionals including speech and language therapy, dietetics, clinical psychology and community-based physical therapy and occupational therapy. It has close links with a chronic fatigue service and a pain clinic that have been running in the locality for over 20 years. The clinic, which is entirely virtual (staff consult either from home or from a small side office in the community trust building), is physically located in a low-rise building on the industrial outskirts of a large town, sharing office space with various community-based health and social care services. Following a 1-h telephone consultation by one of the clinical leads, each patient is discussed at the MDT and then either discharged back to their general practitioner with a detailed management plan or referred on to one of the specialist services. This arrangement evolved to address a particular problem in this locality—that many patients with long covid were being referred by their general practitioner to multiple specialties (e.g. respiratory, neurology, fatigue), leading to a fragmented patient experience, unnecessary specialist assessments and wasteful duplication. The generalist assessment by telephone is oriented to documenting what is often a complex illness narrative (including pre-existing physical and mental comorbidities) and working with the patient to prioritize which symptoms or problems to pursue in which order.

Site E, in a well-regarded inner-city teaching hospital, had been set up in 2020 by a respiratory physician. Its initial ethos and rationale had been “respiratory follow-up”, with strong emphasis on monitoring lung damage via repeated imaging and lung function tests and in ensuring that patients received specialist physical therapy to “re-learn” efficient breathing techniques. Over time, this site has tried to accommodate a more multi-system assessment, with the introduction of a consultant-led infectious disease clinic for patients without a dominant respiratory component, reflecting the shift towards a more fatigue-predominant case mix. At the time of our fieldwork, each patient was seen in turn by a physician, psychologist, occupational therapist and respiratory physical therapist (half an hour each) before all four staff reconvened in a face-to-face MDT meeting to form a plan for each patient. But whilst a wide range of patients with diverse symptoms were discussed at these meetings, there remained a strong focus on respiratory pathology (e.g. tracking improvements in lung function and ensuring that coexisting asthma was optimally controlled).

Site F, one of the first long covid clinics in UK, was set up by a rehabilitation consultant who had been drafted to work on the ICU during the first wave of covid-19 in early 2020. He had a longstanding research interest in whole-patient rehabilitation, especially the assessment and management of chronic fatigue and pain. From the outset, clinic F was more oriented to rehabilitation, including vocational rehabilitation to help patients return to work. There was less emphasis on monitoring lung function or pursuing respiratory comorbidities. At the time of our fieldwork, clinic F offered both a community-based service (“tier 2”) led by an occupational therapist, supported by a respiratory physical therapist and psychologist, and a hospital-based service (“tier 3”) led by the rehabilitation consultant, supported by a wider MDT. Staff in both tiers emphasized that each patient needs a full physical and mental assessment and help to set and work towards achievable goals, whilst staying within safe limits so as to avoid post-exertional symptom exacerbation. Because of the research interest of the lead physician, clinic F adapted well to the growing numbers of patients with fatigue and quickly set up research studies on this cohort [ 84 ].

Details of the other seven sites are shown in Table 1 . Broadly speaking, sites B, E, G and H aligned with the “respiratory follow-up” model and sites F and I aligned with the “rehabilitation” model. Sites A and J had a high-volume, multi-tiered service whose community tier aligned with the “holistic GP assessment” model (site C above) and which also offered a hospital-based, rehabilitation-focused tier. The small service in Scotland (site D) had evolved from an initial respiratory focus to become part of the infectious diseases (ME/CFS) service; Lyme disease (another infectious disease whose sequelae include chronic fatigue) was also prevalent in this region.

The patient experience

Whilst the 10 participating clinics were very diverse in staffing, ethos and patient flows, the 29 patient interviews described remarkably consistent clinic experiences. Almost all identified the biggest problem to be the extended wait of several months before they were seen and the limited awareness (when initially referred) of what long covid clinics could provide. Some talked of how they cried with relief when they finally received an appointment. When the quality improvement collaborative was initially established, waiting times and bottlenecks were patients’ the top priority for quality improvement, and this ranking was shared by clinic staff, who were very aware of how much delays and uncertainties in assessment and treatment compounded patients’ suffering. This issue resolved to a large extent over the study period in all clinics as the referral backlog cleared and the incidence of new cases of long covid fell [ 85 ]; it will be covered in more detail in a separate publication.

Most patients in our sample were satisfied with the care they received when they were finally seen in clinic, especially how they finally felt “heard” after a clinician took a full history. They were relieved to receive affirmation of their experience, a diagnosis of what was wrong and reassurance that they were believed. They were grateful for the input of different members of the multidisciplinary teams and commented on the attentiveness, compassion and skill of allied professionals in particular (“she was wonderful, she got me breathing again”—patient BIR145 talking about a physical therapist). One or two patient participants expressed confusion about who exactly they had seen and what advice they had been given, and some did not realize that a telephone assessment had been an actual clinical consultation. A minority expressed disappointment that an expected investigation had not been ordered (one commented that they had not had any blood tests at all). Several had assumed that the help and advice from the long covid clinic would continue to be offered until they were better and were disappointed that they had been discharged after completing the various courses on offer (since their clinic had been set up as an “assessment only” service).

In the next sections, we give examples of topics raised in the quality improvement collaborative and how they were addressed.

Example quality topic 1: Outcome measures

The first topic considered by the quality improvement collaborative was how (that is, using which measures and metrics) to assess and monitor patients with long covid. In the absence of a validated biomarker, various symptom scores and quality of life scales—both generic and disease-specific—were mooted. Site F had already developed and validated a patient-reported outcome measure (PROM), the C19-YRS (Covid-19 Yorkshire Rehabilitation Scale) and used it for both research and clinical purposes [ 86 ]. It was quickly agreed that, for the purposes of generating comparative research findings across the ten clinics, the C19-YRS should be used at all sites and completed by patients three-monthly. A commercial partner produced an electronic version of this instrument and an app for patient smartphones. The quality improvement collaborative also agreed that patients should be asked to complete the EUROQOL EQ5D, a widely used generic health-related quality of life scale [ 87 ], in order to facilitate comparisons between long covid and other chronic conditions.

In retrospect, the discussions which led to the unopposed adoption of these two measures as a “quality” initiative in clinical care were somewhat aspirational. A review of progress at a subsequent quality improvement meeting revealed considerable variation among clinics, with a wide variety of measures used in different clinics to different degrees. Reasons for this variation were multiple. First, although our patient advisory group were keen that we should gather as much data as possible on the patient experience of this new condition, many clinic patients found the long questionnaires exhausting to complete due to cognitive impairment and fatigue. In addition, whilst patients were keen to answer questions on symptoms that troubled them, many had limited patience to fill out repeated surveys on symptoms that did not trouble them (“it almost felt as if I’ve not got long covid because I didn’t feel like I fit the criteria as they were laying it out”—patient SAL001). Staff assisted patients in completing the measures when needed, but this was time-consuming (up to 45 min per instrument) and burdensome for both staff and patients. In clinics where a high proportion of patients required assistance, staff time was the rate-limiting factor for how many instruments got completed. For some patients, one short instrument was the most that could be asked of them, and the clinician made a judgement on which one would be in their best interests on the day.

The second reason for variation was that the clinical diagnosis and management of particular features, complications and comorbidities of long covid required more nuance than was provided by these relatively generic instruments, and the level of detail sought varied with the specialist interest of the clinic (and the clinician). The modified C19-YRS [ 88 ], for example, contained 19 items, of which one asked about sleep quality. But if a patient had sleep difficulties, many clinicians felt that these needed to be documented in more detail—for example using the 8-item Epworth Sleepiness Scale, originally developed for conditions such as narcolepsy and obstructive sleep apnea [ 89 ]. The “Epworth score” was essential currency for referrals to some but not all specialist sleep services. Similarly, the C19-YRS had three items relating to anxiety, depression and post-traumatic stress disorder, but in clinics where there was a strong focus on mental health (e.g. when there was a resident psychologist), patients were usually invited to complete more specific tools (e.g. the Patient Health Questionnaire 9 [ 90 ], a 9-item questionnaire originally designed to assess severity of depression).

The third reason for variation was custom and practice. Ethnographic visits revealed that paper copies of certain instruments were routinely stacked on clinicians’ desks in outpatient departments and also (in some cases) handed out by administrative staff in waiting areas so that patients could complete them before seeing the clinician. These familiar clinic artefacts tended to be short (one-page) instruments that had a long tradition of use in clinical practice. They were not always fit for purpose. For example, the Nijmegen questionnaire was developed in the 1980s to assess hyperventilation; it was validated against a longer, “gold standard” instrument for that condition [ 91 ]. It subsequently became popular in respiratory clinics to diagnose or exclude breathing pattern disorder (a condition in which the normal physiological pattern of breathing becomes replaced with less efficient, shallower breathing [ 92 ]), so much so that the researchers who developed the instrument published a paper to warn fellow researchers that it had not been validated for this purpose [ 93 ]. Whilst a validated 17-item instrument for breathing pattern disorder (the Self-Evaluation of Breathing Questionnaire [ 94 ]) does exist, it is not in widespread clinical use. Most clinics in LOCOMOTION used Nijmegen either on all patients (e.g. as part of a comprehensive initial assessment, especially if the service had begun as a respiratory follow-up clinic) or when breathing pattern disorder was suspected.

In sum, the use of outcome measures in long covid clinics was a compromise between standardization and contingency. On the one hand, all clinics accepted the need to use “validated” instruments consistently. On the other hand, there were sometimes good reasons why they deviated from agreed practice, including mismatch between the clinic’s priorities as a research site, its priorities as a clinical service, and the particular clinical needs of a patient; the clinic’s—and the clinician’s—specialist focus; and long-held traditions of using particular instruments with which staff and patients were familiar.

Example quality topic 2: Postural orthostatic tachycardia syndrome (POTS)

Palpitations (common in long covid) and postural orthostatic tachycardia syndrome (POTS, a disproportionate acceleration in heart rate on standing, the assumed cause of palpitations in many long covid patients) was the top priority for quality improvement identified by our patient advisory group. Reflecting discussions and evidence (of various kinds) shared in online patient communities, the group were confident that POTS is common in long covid patients and that many cases remain undetected (perhaps misdiagnosed as anxiety). Their request that all long covid patients should be “screened” for POTS prompted a search for, and synthesis of, evidence (which we published in the BMJ [ 95 ]). In sum, that evidence was sparse and contested, but, combined with standard practice in specialist clinics, broadly supported the judicious use of the NASA Lean Test [ 96 ]. This test involves repeated measurements of pulse and blood pressure with the patient first lying and then standing (with shoulders resting against a wall).

The patient advisory group’s request that the NASA Lean Test should be conducted on all patients met with mixed responses from the clinics. In site F, the lead physician had an interest in autonomic dysfunction in chronic fatigue and was keen; he had already published a paper on how to adapt the NASA Lean Test for self-assessment at home [ 97 ]. Several other sites were initially opposed. Staff at site E, for example, offered various arguments:

The test is time-consuming, labor-intensive, and takes up space in the clinic which has an opportunity cost in terms of other potential uses;

The test is unvalidated and potentially misleading (there is a high incidence of both false negative and false positive results);

There is no proven treatment for POTS, so there is no point in testing for it;

It is a specialist test for a specialist condition, so it should be done in a specialist clinic where its benefits and limitations are better understood;

Objective testing does not change clinical management since what we treat is the patient’s symptoms (e.g. by a pragmatic trial of lifestyle measures and medication);

People with symptoms suggestive of dysautonomia have already been “triaged out” of this clinic (that is, identified in the initial telephone consultation and referred directly to neurology or cardiology);

POTS is a manifestation of the systemic nature of long covid; it does not need specific treatment but will improve spontaneously as the patient goes through standard interventions such as active pacing, respiratory physical therapy and sleep hygiene;

Testing everyone, even when asymptomatic, runs counter to the ethos of rehabilitation, which is to “de-medicalize” patients so as to better orient them to their recovery journey.

When clinics were invited to implement the NASA Lean Test on a consecutive sample of patients to resolve a dispute about the incidence of POTS (from “we’ve only seen a handful of people with it since the clinic began” to “POTS is common and often missed”), all but one site agreed to participate. The tertiary POTS centre linked to site H was already running the NASA Lean Test as standard on all patients. Site C, which operated entirely virtually, passed the work to the referring general practitioner by making this test a precondition for seeing the patient; site D, which was largely virtual, sent instructions for patients to self-administer the test at home.

The NASA Lean Test study has been published separately [ 98 ]. In sum, of 277 consecutive patients tested across the eight clinics, 20 (7%) had a positive NASA Lean Test for POTS and a further 28 (10%) a borderline result. Six of 20 patients who met the criteria for POTS on testing had no prior history of orthostatic intolerance. The question of whether this test should be used to “screen” all patients was not answered definitively. But the experience of participating in the study persuaded some sceptics that postural changes in heart rate could be severe in some long covid patients, did not appear to be fully explained by their previously held theories (e.g. “functional”, anxiety, deconditioning), and had likely been missed in some patients. The outcome of this particular quality improvement cycle was thus not a wholescale change in practice (for which the evidence base was weak) but a more subtle increase in clinical awareness, a greater willingness to consider testing for POTS and a greater commitment to contribute to research into this contested condition.

More generally, the POTS audit prompted some clinicians to recognize the value of quality improvement in novel clinical areas. One physician who had initially commented that POTS was not seen in their clinic, for example, reflected:

“ Our clinic population is changing. […] Overall there’s far fewer post-ICU patients with ECMO [extra-corporeal membrane oxygenation] issues and far more long covid from the community, and this is the bit our clinic isn’t doing so well on. We’re doing great on breathing pattern disorder; neuro[logists] are helping us with the brain fogs; our fatigue and occupational advice is ok but some of the dysautonomia symptoms that are more prevalent in the people who were not hospitalized – that’s where we need to improve .” -Respiratory physician, site G (from field visit 6.6.23)

Example quality topic 3: Management of fatigue

Fatigue was the commonest symptom overall and a high priority among both patients and clinicians for quality improvement. It often coexisted with the cluster of neurocognitive symptoms known as brain fog, with both conditions relapsing and remitting in step. Clinicians were keen to systematize fatigue management using a familiar clinical framework oriented around documenting a full clinical history, identifying associated symptoms, excluding or exploring comorbidities and alternative explanations (e.g. poor sleep patterns, depression, menopause, deconditioning), assessing how fatigue affects physical and mental function, implementing a program of physical and cognitive therapy that was sensitive to the patient’s condition and confidence level, and monitoring progress using validated patient-reported outcome measures and symptom diaries.

The underpinning logic of this approach, which broadly reflected World Health Organization guidance [ 99 ], was that fatigue and linked cognitive impairment could be a manifestation of many—perhaps interacting—conditions but that a whole-patient (body and mind) rehabilitation program was the cornerstone of management in most cases. Discussion in the quality improvement collaborative focused on issues such as whether fatigue was so severe that it produced safety concerns (e.g. in a person’s job or with childcare), the pros and cons of particular online courses such as yoga, relaxation and mindfulness (many were viewed positively, though the evidence base was considered weak), and the extent to which respiratory physical therapy had a crossover impact on fatigue (systematic reviews suggested that it may do, but these reviews also cautioned that primary studies were sparse, methodologically flawed, and heterogeneous [ 100 , 101 ]). They also debated the strengths and limitations of different fatigue-specific outcome measures, each of which had been developed and validated in a different condition, with varying emphasis on cognitive fatigue, physical fatigue, effect on daily life, and motivation. These instruments included the Modified Fatigue Impact Scale; Fatigue Severity Scale [ 102 ]; Fatigue Assessment Scale; Functional Assessment Chronic Illness Therapy—Fatigue (FACIT-F) [ 103 ]; Work and Social Adjustment Scale [ 104 ]; Chalder Fatigue Scale [ 105 ]; Visual Analogue Scale—Fatigue [ 106 ]; and the EQ5D [ 87 ]. In one clinic (site F), three of these scales were used in combination for reasons discussed below.

Some clinicians advocated melatonin or nutritional supplements (such as vitamin D or folic acid) for fatigue on the grounds that many patients found them helpful and formal placebo-controlled trials were unlikely ever to be conducted. But neurostimulants used in other fatigue-predominant conditions (e.g. brain injury, stroke), which also lacked clinical trial evidence in long covid, were viewed as inappropriate in most patients because of lack of evidence of clear benefit and hypothetical risk of harm (e.g. adverse drug reactions, polypharmacy).

Whilst the patient advisory group were broadly supportive of a whole-patient rehabilitative approach to fatigue, their primary concern was fatiguability , especially post-exertional symptom exacerbation (PESE, also known as “crashes”). In these, the patient becomes profoundly fatigued some hours or days after physical or mental exertion, and this state can last for days or even weeks [ 107 ]. Patients viewed PESE as a “red flag” symptom which they felt clinicians often missed and sometimes caused. They wanted the quality improvement effort to focus on ensuring that all clinicians were aware of the risks of PESE and acted accordingly. A discussion among patients and clinicians at a quality improvement collaborative meeting raised a new research hypothesis—that reducing the number of repeated episodes of PESE may improve the natural history of long covid.

These tensions around fatigue management played out differently in different clinics. In site C (the GP-led virtual clinic run from a community hub), fatigue was viewed as one manifestation of a whole-patient condition. The lead general practitioner used the metaphor of untangling a skein of wool: “you have to find the end and then gently pull it”. The underlying problem in a fatigued patient, for example, might be an undiagnosed physical condition such as anaemia, disturbed sleep, or inadequate pacing. These required (respectively) the chronic fatigue service (comprising an occupational therapist and specialist psychologist and oriented mainly to teaching the techniques of goal-setting and pacing), a “tiredness” work-up (e.g. to exclude anaemia or menopause), investigation of poor sleep (which, not uncommonly, was due to obstructive sleep apnea), and exploration of mental health issues.

In site G (a hospital clinic which had evolved from a respiratory service), patients with fatigue went through a fatigue management program led by the occupational therapist with emphasis on pacing, energy conservation, avoidance of PESE and sleep hygiene. Those without ongoing respiratory symptoms were often discharged back to their general practitioner once they had completed this; there was no consultant follow-up of unresolved fatigue.

In site F (a rehabilitation clinic which had a longstanding interest in chronic fatigue even before the pandemic), active interdisciplinary management of fatigue was commenced at or near the patient’s first visit, on the grounds that the earlier this began, the more successful it would be. In this clinic, patients were offered a more intensive package: a similar occupational therapy-led fatigue course as those in site G, plus input from a dietician to advise on regular balanced meals and caffeine avoidance and a group-based facilitated peer support program which centred on fatigue management. The dietician spoke enthusiastically about how improving diet in longstanding long covid patients often improved fatigue (e.g. because they had often lost muscle mass and tended to snack on convenience food rather than make meals from scratch), though she agreed there was no evidence base from trials to support this approach.

Pursuing local quality improvement through MDTs

Whilst some long covid patients had “textbook” symptoms and clinical findings, many cases were unique and some were fiendishly complex. One clinician commented that, somewhat paradoxically, “easy cases” were often the post-ICU follow-ups who had resolving chest complications; they tended to do well with a course of respiratory physical therapy and a return-to-work program. Such cases were rarely brought to MDT meetings. “Difficult cases” were patients who had not been hospitalized for their acute illness but presented with a months- or years-long history of multiple symptoms with fatigue typically predominant. Each one was different, as the following example (some details of which have been fictionalized to protect anonymity) illustrates.

The MDT is discussing Mrs Fermah, a 65-year-old homemaker who had covid-19 a year ago. She has had multiple symptoms since, including fluctuating fatigue, brain fog, breathlessness, retrosternal chest pain of burning character, dry cough, croaky voice, intermittent rashes (sometimes on eating), lips going blue, ankle swelling, orthopnoea, dizziness with the room spinning which can be triggered by stress, low back pain, aches and pains in the arms and legs and pins and needles in the fingertips, loss of taste and smell, palpitations and dizziness (unclear if postural, but clear association with nausea), headaches on waking, and dry mouth. She is somewhat overweight (body mass index 29) and admits to low mood. Functionally, she is mostly confined to the house and can no longer manage the stairs so has begun to sleep downstairs. She has stumbled once or twice but not fallen. Her social life has ceased and she rarely has the energy to see her grandchildren. Her 70-year-old husband is retired and generally supportive, though he spends most evenings at his club. Comorbidities include glaucoma which is well controlled and overseen by an ophthalmologist, mild club foot (congenital) and stage 1 breast cancer 20 years ago. Various tests, including a chest X-ray, resting and exercise oximetry and a blood panel, were normal except for borderline vitamin D level. Her breathing questionnaire score suggests she does not have breathing pattern disorder. ECG showed first-degree atrioventricular block and left axis deviation. No clinician has witnessed the blue lips. Her current treatment is online group respiratory physical therapy; a home visit is being arranged to assess her climbing stairs. She has declined a psychologist assessment. The consultant asks the nurse who assessed her: “Did you get a feel if this is a POTS-type dizziness or an ENT-type?” She sighs. “Honestly it was hard to tell, bless her.”—Site A MDT

This patient’s debilitating symptoms and functional impairments could all be due to long covid, yet “evidence-based” guidance for how to manage her complex suffering does not exist and likely never will exist. The question of which (if any) additional blood or imaging tests to do, in what order of priority, and what interventions to offer the patient will not be definitively answered by consulting clinical trials involving hundreds of patients, since (even if these existed) the decision involves weighing this patient’s history and the multiple factors and uncertainties that are relevant in her case. The knowledge that will help the MDT provide quality care to Mrs Fermah is case-based knowledge—accumulated clinical experience and wisdom from managing and deliberating on multiple similar cases. We consider case-based knowledge further in the “ Discussion ”.

Summary of key findings

This study has shown that a quality improvement collaborative of UK long covid clinics made some progress towards standardizing assessment and management in some topics, but some variation remained. This could be explained in part by the fact that different clinics had different histories and path dependencies, occupied a different place in the local healthcare ecosystem, served different populations, were differently staffed, and had different clinical interests. Our patient advisory group and clinicians in the quality improvement collaborative broadly prioritized the same topics for improvement but interpreted them somewhat differently. “Quality” long covid care had multiple dimensions, relating to (among other things) service set-up and accessibility, clinical provision appropriate to the patient’s need (including options for referral to other services locally), the human qualities of clinical and support staff, how knowledge was distributed across (and accessible within) the system, and the accumulated collective wisdom of local MDTs in dealing with complex cases (including multiple kinds of specialist expertise as well as relational knowledge of what was at stake for the patient). Whilst both staff and patients were keen to contribute to the quality improvement effort, the burden of measurement was evident: multiple outcome measures, used repeatedly, were resource-intensive for staff and exhausting for patients.

Strengths and limitations of this study

To our knowledge, we are the first to report both a quality improvement collaborative and an in-depth qualitative study of clinical work in long covid. Key strengths of this work include the diverse sampling frame (with sites from three UK jurisdictions and serving widely differing geographies and demographics); the use of documents, interviews and reflexive interpretive ethnography to produce meaningful accounts of how clinics emerged and how they were currently organized; the use of philosophical concepts to analyse data on how MDTs produced quality care on a patient-by-patient basis; and the close involvement of patient co-researchers and coauthors during the research and writing up.

Limitations of the study include its exclusive UK focus (the external validity of findings to other healthcare systems is unknown); the self-selecting nature of participants in a quality improvement collaborative (our patient advisory group suggested that the MDTs observed in this study may have represented the higher end of a quality spectrum, hence would be more likely than other MDTs to adhere to guidelines); and the particular perspective brought by the researchers (two GPs, a physical therapist and one non-clinical person) in ethnographic observations. Hospital specialists or organizational scholars, for example, may have noticed different things or framed what they observed differently.

Explaining variation in long covid care

Sutherland and Levesque’s framework mentioned in the “ Background ” section does not explain much of the variation found in our study [ 70 ]. In terms of capacity, at the time of this study most participating clinics benefited from ring-fenced resources. In terms of evidence, guidelines existed and were not greatly contested, but as illustrated by the case of Mrs Fermah above, many patients were exceptions to the guideline because of complex symptomatology and relevant comorbidities. In terms of agency, clinicians in most clinics were passionately engaged with long covid (they were pioneers who had set up their local clinic and successfully bid for national ring-fenced resources) and were generally keen to support patient choice (though not if the patient requested tests which were unavailable or deemed not indicated).

Astma et al.’s list of factors that may explain variation in practice (see “ Background ”) includes several that may be relevant to long covid, especially that the definition of appropriate care in this condition remains somewhat contested. But lack of opportunity to discuss cases was not a problem in the clinics in our sample. On the contrary, MDT meetings in each locality gave clinicians multiple opportunities to discuss cases with colleagues and reflect collectively on whether and how to apply particular guidelines.

The key problem was not that clinicians disputed the guidelines for managing long covid or were unaware of them; it was that the guidelines were not self-interpreting . Rather, MDTs had to deliberate on the balance of benefits and harms in different aspects of individual cases. In patients whose symptoms suggested a possible diagnosis of POTS (or who suspected themselves of having POTS), for example, these deliberations were sometimes lengthy and nuanced. Should a test result that is not technically in the abnormal range but close to it be treated as diagnostic, given that symptoms point to this diagnosis? If not, should the patient be told that the test excludes POTS or that it is equivocal? If a cardiology opinion has stated firmly that the patient does not have POTS but the cardiologist is not known for their interest in this condition, should a second specialist opinion be sought? If the gold standard “tilt test” [ 108 ] for POTS (usually available only in tertiary centres) is not available locally, does this patient merit a costly out-of-locality referral? Should the patient’s request for a trial of off-label medication, reflecting discussions in an online support group, be honoured? These are the kinds of questions on which MDTs deliberated at length.

The fact that many cases required extensive deliberation does not necessarily justify variation in practice among clinics. But taking into account the clinics’ very different histories, set-up, and local referral pathways, the variation begins to make sense. A patient who is being assessed in a clinic that functions as a specialist chronic fatigue centre and attracts referrals which reflect this interest (e.g. site F in our sample) will receive different management advice from one that functions as a telephone-only generalist assessment centre and refers on to other specialties (site C in our sample). The wide variation in case mix, coupled with the fact that a different proportion of these cases were highly complex in each clinic (and in different ways), suggests that variation in practice may reflect appropriate rather than inappropriate care.

Our patient advisory group affirmed that many of the findings reported here resonated with their own experience, but they raised several concerns. These included questions about patient groups who may have been missed in our sample because they were rarely discussed in MDTs. The decision to take a case to MDT discussion is taken largely by a clinician, and there was evidence from online support groups that some patients’ requests for their case to be taken to an MDT had been declined (though not, to our knowledge, in the clinics participating in the LOCOMOTION study).

We began this study by asking “what is quality in long covid care?”. We initially assumed that this question referred to a generalizable evidence base, which we felt we could identify, and we believed that we could then determine whether long covid clinics were following the evidence base through conventional audits of structure, process, and outcome. In retrospect, these assumptions were somewhat naïve. On the basis of our findings, we suggest that a better (and more individualized) research question might be “to what extent does each patient with long covid receive evidence-based care appropriate to their needs?”. This question would require individual case review on a sample of cases, tracking each patient longitudinally including cross-referrals, and also interviewing the patient.

Nomothetic versus idiographic knowledge

In a series of lectures first delivered in the 1950s and recently republished [ 109 ], psychiatrist Dr Maurice O’Connor Drury drew on the later philosophy of his friend and mentor Ludwig Wittgenstein to challenge what he felt was a concerning trend: that the nomothetic (generalizable, abstract) knowledge from randomized controlled trials (RCTs) was coming to over-ride the idiographic (personal, situated) knowledge about particular patients. Based on Wittgenstein’s writings on the importance of the particular, Drury predicted—presciently—that if implemented uncritically, RCTs would result in worse, not better, care for patients, since it would go hand-in-hand with a downgrading of experience, intuition, subjective judgement, personal reflection, and collective deliberation.

Much conventional quality improvement methodology is built on an assumption that nomothetic knowledge (for example, findings from RCTs and systematic reviews) is a higher form of knowing than idiographic knowledge. But idiographic, case-based reasoning—despite its position at the very bottom of evidence-based medicine’s hierarchy of evidence [ 110 ]—is a legitimate and important element of medical practice. Bioethicist Kathryn Montgomery, drawing on Aristotle’s notion of praxis , considers clinical practice to be an example of case-based reasoning [ 111 ]. Medicine is governed not by hard and fast laws but by competing maxims or rules of thumb ; the essence of judgement is deciding which (if any) rule should be applied in a particular circumstance. Clinical judgement incorporates science (especially the results of well-conducted research) and makes use of available tools and technologies (including guidelines and decision-support algorithms that incorporate research findings). But rather than being determined solely by these elements, clinical judgement is guided both by the scientific evidence and by the practical and ethical question “what is it best to do, for this individual, given these circumstances?”.

In this study, we observed clinical management of, and MDT deliberations on, hundreds of clinical cases. In the more straightforward ones (for example, recovering pneumonitis), guideline-driven care was not difficult to implement and such cases were rarely brought to the MDT. But cases like Mrs Fermah (see last section of “ Results ”) required much discussion on which aspects of which guideline were in the patient’s best interests to bring into play at any particular stage in their illness journey.

Conclusions

One systematic review on quality improvement collaboratives concluded that “ [those] reporting success generally addressed relatively straightforward aspects of care, had a strong evidence base and noted a clear evidence-practice gap in an accepted clinical pathway or guideline” (page 226) [ 60 ]. The findings from this study suggest that to the extent that such collaboratives address clinical cases that are not straightforward, conventional quality improvement methods may be less useful and even counterproductive.

The question “what is quality in long covid care?” is partly a philosophical one. Our findings support an approach that recognizes and values idiographic knowledge —including establishing and protecting a safe and supportive space for deliberation on individual cases to occur and to value and draw upon the collective learning that occurs in these spaces. It is through such deliberation that evidence-based guidelines can be appropriately interpreted and applied to the unique needs and circumstances of individual patients. We suggest that Drury’s warning about the limitations of nomothetic knowledge should prompt a reassessment of policies that rely too heavily on such knowledge, resulting in one-size-fits-all protocols. We also cautiously hypothesize that the need to centre the quality improvement effort on idiographic rather than nomothetic knowledge is unlikely to be unique to long covid. Indeed, such an approach may be particularly important in any condition that is complex, unpredictable, variable in presentation and clinical course, and associated with comorbidities.

Availability of data and materials

Selected qualitative data (ensuring no identifiable information) will be made available to formal research teams on reasonable request to Professor Greenhalgh at the University of Oxford, on condition that they have research ethics approval and relevant expertise. The quantitative data on NASA Lean Test have been published in full in a separate paper [ 98 ].

Abbreviations

Chronic fatigue syndrome

Intensive care unit

Jenny Ceolta-Smith

Julie Darbyshire

LOng COvid Multidisciplinary consortium Optimising Treatments and services across the NHS

Multidisciplinary team

Myalgic encephalomyelitis

Middle East Respiratory Syndrome

National Aeronautics and Space Association

Occupational therapy/ist

Post-exertional symptom exacerbation

Postural orthostatic tachycardia syndrome

Speech and language therapy

Severe Acute Respiratory Syndrome

Trisha Greenhalgh

United Kingdom

United States

World Health Organization

Perego E, Callard F, Stras L, Melville-JÛhannesson B, Pope R, Alwan N. Why the Patient-Made Term “Long Covid” is needed. Wellcome Open Res. 2020;5:224.

Article Google Scholar

Greenhalgh T, Sivan M, Delaney B, Evans R, Milne R: Long covid—an update for primary care. bmj 2022;378:e072117.

Centers for Disease Control and Prevention (US): Long COVID or Post-COVID Conditions (updated 16th December 2022). Atlanta: CDC. Accessed 2nd June 2023 at https://www.cdc.gov/coronavirus/2019-ncov/long-term-effects/index.html ; 2022.

National Institute for Health and Care Excellence (NICE) Scottish Intercollegiate Guidelines Network (SIGN) and Royal College of General Practitioners (RCGP): COVID-19 rapid guideline: managing the long-term effects of COVID-19, vol. Accessed 30th January 2022 at https://www.nice.org.uk/guidance/ng188/resources/covid19-rapid-guideline-managing-the-longterm-effects-of-covid19-pdf-51035515742 . London: NICE; 2022.

Organization WH: Post Covid-19 Condition (updated 7th December 2022), vol. Accessed 2nd June 2023 at https://www.who.int/europe/news-room/fact-sheets/item/post-covid-19-condition#:~:text=It%20is%20defined%20as%20the,months%20with%20no%20other%20explanation . Geneva: WHO; 2022.

Office for National Statistics: Prevalence of ongoing symptoms following coronavirus (COVID-19) infection in the UK: 31st March 2023. London: ONS. Accessed 30th May 2023 at https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/datasets/alldatarelatingtoprevalenceofongoingsymptomsfollowingcoronaviruscovid19infectionintheuk ; 2023.

Crook H, Raza S, Nowell J, Young M, Edison P: Long covid—mechanisms, risk factors, and management. bmj 2021;374.

Sudre CH, Murray B, Varsavsky T, Graham MS, Penfold RS, Bowyer RC, Pujol JC, Klaser K, Antonelli M, Canas LS. Attributes and predictors of long COVID. Nat Med. 2021;27(4):626–31.

Article CAS PubMed PubMed Central Google Scholar

Reese JT, Blau H, Casiraghi E, Bergquist T, Loomba JJ, Callahan TJ, Laraway B, Antonescu C, Coleman B, Gargano M: Generalisable long COVID subtypes: findings from the NIH N3C and RECOVER programmes. EBioMedicine 2023;87.

Thaweethai T, Jolley SE, Karlson EW, Levitan EB, Levy B, McComsey GA, McCorkell L, Nadkarni GN, Parthasarathy S, Singh U. Development of a definition of postacute sequelae of SARS-CoV-2 infection. JAMA. 2023;329(22):1934–46.

Brown DA, O’Brien KK. Conceptualising Long COVID as an episodic health condition. BMJ Glob Health. 2021;6(9): e007004.

Article PubMed Google Scholar

Tate WP, Walker MO, Peppercorn K, Blair AL, Edgar CD. Towards a Better Understanding of the Complexities of Myalgic Encephalomyelitis/Chronic Fatigue Syndrome and Long COVID. Int J Mol Sci. 2023;24(6):5124.

Ahmed H, Patel K, Greenwood DC, Halpin S, Lewthwaite P, Salawu A, Eyre L, Breen A, Connor RO, Jones A. Long-term clinical outcomes in survivors of severe acute respiratory syndrome (SARS) and Middle East respiratory syndrome coronavirus (MERS) outbreaks after hospitalisation or ICU admission: a systematic review and meta-analysis. J Rehabil Med. 2020;52(5):1–11.

Google Scholar

World Health Organisation: Clinical management of severe acute respiratory infection (SARI) when COVID-19 disease is suspected: Interim guidance (13th March 2020). Geneva: WHO. Accessed 3rd January 2023 at https://t.co/JpNdP8LcV8?amp=1 ; 2020.

Rushforth A, Ladds E, Wieringa S, Taylor S, Husain L, Greenhalgh T: Long Covid – the illness narratives. Under review for Sociology of Health and Illness 2021.

Russell D, Spence NJ. Chase J-AD, Schwartz T, Tumminello CM, Bouldin E: Support amid uncertainty: Long COVID illness experiences and the role of online communities. SSM-Qual Res Health. 2022;2: 100177.

Article PubMed PubMed Central Google Scholar

Ziauddeen N, Gurdasani D, O’Hara ME, Hastie C, Roderick P, Yao G, Alwan NA. Characteristics and impact of Long Covid: Findings from an online survey. PLoS ONE. 2022;17(3): e0264331.

Evans RA, McAuley H, Harrison EM, Shikotra A, Singapuri A, Sereno M, Elneima O, Docherty AB, Lone NI, Leavy OC. Physical, cognitive, and mental health impacts of COVID-19 after hospitalisation (PHOSP-COVID): a UK multicentre, prospective cohort study. Lancet Respir Med. 2021;9(11):1275–87.

Sykes DL, Holdsworth L, Jawad N, Gunasekera P, Morice AH, Crooks MG. Post-COVID-19 symptom burden: what is long-COVID and how should we manage it? Lung. 2021;199(2):113–9.

Altmann DM, Whettlock EM, Liu S, Arachchillage DJ, Boyton RJ: The immunology of long COVID. Nat Rev Immunol 2023:1–17.

Klein J, Wood J, Jaycox J, Dhodapkar RM, Lu P, Gehlhausen JR, Tabachnikova A, Greene K, Tabacof L, Malik AA et al : Distinguishing features of Long COVID identified through immune profiling. Nature 2023.

Chen B, Julg B, Mohandas S, Bradfute SB. Viral persistence, reactivation, and mechanisms of long COVID. Elife. 2023;12: e86015.

Wang C, Ramasamy A, Verduzco-Gutierrez M, Brode WM, Melamed E. Acute and post-acute sequelae of SARS-CoV-2 infection: a review of risk factors and social determinants. Virol J. 2023;20(1):124.

Cervia-Hasler C, Brüningk SC, Hoch T, Fan B, Muzio G, Thompson RC, Ceglarek L, Meledin R, Westermann P, Emmenegger M et al Persistent complement dysregulation with signs of thromboinflammation in active Long Covid Science 2024;383(6680):eadg7942.

Sivan M, Greenhalgh T, Darbyshire JL, Mir G, O’Connor RJ, Dawes H, Greenwood D, O’Connor D, Horton M, Petrou S. LOng COvid Multidisciplinary consortium Optimising Treatments and servIces acrOss the NHS (LOCOMOTION): protocol for a mixed-methods study in the UK. BMJ Open. 2022;12(5): e063505.

Rushforth A, Ladds E, Wieringa S, Taylor S, Husain L, Greenhalgh T. Long covid–the illness narratives. Soc Sci Med. 2021;286: 114326.

National Institute for Health and Care Excellence: COVID-19 rapid guideline: managing the long-term effects of COVID-19, vol. Accessed 4th October 2023 at https://www.nice.org.uk/guidance/ng188/resources/covid19-rapid-guideline-managing-the-longterm-effects-of-covid19-pdf-51035515742 . London: NICE 2020.

NHS England: Long COVID: the NHS plan for 2021/22. London: NHS England. Accessed 2nd August 2022 at https://www.england.nhs.uk/coronavirus/documents/long-covid-the-nhs-plan-for-2021-22/ ; 2021.

NHS England: NHS to offer ‘long covid’ sufferers help at specialist centres. London: NHS England. Accessed 10th October 2020 at https://www.england.nhs.uk/2020/10/nhs-to-offer-long-covid-help/ ; 2020 (7th October).

NHS England: The NHS plan for improving long COVID services, vol. Acessed 4th February 2024 at https://www.england.nhs.uk/publication/the-nhs-plan-for-improving-long-covid-services/ .London: Gov.uk; 2022.

NHS England: Commissioning guidance for post-COVID services for adults, children and young people, vol. Accessed 6th February 2024 at https://www.england.nhs.uk/long-read/commissioning-guidance-for-post-covid-services-for-adults-children-and-young-people/ . London: gov.uk; 2023.

National Institute for Health Research: Researching Long Covid: Adressing a new global health challenge, vol. Accessed 9.8.23 at https://evidence.nihr.ac.uk/collection/researching-long-covid-addressing-a-new-global-health-challenge/ . London: NIHR; 2022.

Subbaraman N. NIH will invest $1 billion to study long COVID. Nature. 2021;591(7850):356–356.

Article CAS PubMed Google Scholar

Donabedian A. The definition of quality and approaches to its assessment and monitoring. Ann Arbor: Michigan; 1980.

Laffel G, Blumenthal D. The case for using industrial quality management science in health care organizations. JAMA. 1989;262(20):2869–73.

Maxwell RJ. Quality assessment in health. BMJ. 1984;288(6428):1470.

Berwick DM, Godfrey BA, Roessner J. Curing health care: New strategies for quality improvement. The Journal for Healthcare Quality (JHQ). 1991;13(5):65–6.

Deming WE. Out of the Crisis. Cambridge, MA: MIT Press; 1986.

Argyris C: Increasing leadership effectiveness: New York: J. Wiley; 1976.

Juran JM: A history of managing for quality: The evolution, trends, and future directions of managing for quality: Asq Press; 1995.

Institute of Medicine (US): Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001.

McNab D, McKay J, Shorrock S, Luty S, Bowie P. Development and application of ‘systems thinking’ principles for quality improvement. BMJ Open Qual. 2020;9(1): e000714.

Sampath B, Rakover J, Baldoza K, Mate K, Lenoci-Edwards J, Barker P. Whole-System Quality: A Unified Approach to Building Responsive, Resilient Health Care Systems. Boston: Institute for Healthcare Immprovement; 2021.

Batalden PB, Davidoff F: What is “quality improvement” and how can it transform healthcare? In . , vol. 16: BMJ Publishing Group Ltd; 2007: 2–3.

Baker G. Collaborating for improvement: the Institute for Healthcare Improvement’s breakthrough series. New Med. 1997;1:5–8.

Plsek PE. Collaborating across organizational boundaries to improve the quality of care. Am J Infect Control. 1997;25(2):85–95.

Ayers LR, Beyea SC, Godfrey MM, Harper DC, Nelson EC, Batalden PB. Quality improvement learning collaboratives. Qual Manage Healthcare. 2005;14(4):234–47.

Brandrud AS, Schreiner A, Hjortdahl P, Helljesen GS, Nyen B, Nelson EC. Three success factors for continual improvement in healthcare: an analysis of the reports of improvement team members. BMJ Qual Saf. 2011;20(3):251–9.

Dückers ML, Spreeuwenberg P, Wagner C, Groenewegen PP. Exploring the black box of quality improvement collaboratives: modelling relations between conditions, applied changes and outcomes. Implement Sci. 2009;4(1):1–12.

Nadeem E, Olin SS, Hill LC, Hoagwood KE, Horwitz SM. Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q. 2013;91(2):354–94.

Shortell SM, Marsteller JA, Lin M, Pearson ML, Wu S-Y, Mendel P, Cretin S, Rosen M: The role of perceived team effectiveness in improving chronic illness care. Medical Care 2004:1040–1048.

Wilson T, Berwick DM, Cleary PD. What do collaborative improvement projects do? Experience from seven countries. Joint Commission J Qual Safety. 2004;30:25–33.

Schouten LM, Hulscher ME, van Everdingen JJ, Huijsman R, Grol RP. Evidence for the impact of quality improvement collaboratives: systematic review. BMJ. 2008;336(7659):1491–4.

Hulscher ME, Schouten LM, Grol RP, Buchan H. Determinants of success of quality improvement collaboratives: what does the literature show? BMJ Qual Saf. 2013;22(1):19–31.

Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011;89(2):167–205.

Bate P, Mendel P, Robert G: Organizing for quality: the improvement journeys of leading hospitals in Europe and the United States: CRC Press; 2007.

Andersson-Gäre B, Neuhauser D. The health care quality journey of Jönköping County Council. Sweden Qual Manag Health Care. 2007;16(1):2–9.

Törnblom O, Stålne K, Kjellström S. Analyzing roles and leadership in organizations from cognitive complexity and meaning-making perspectives. Behav Dev. 2018;23(1):63.

Greenhalgh T, Russell J. Why Do Evaluations of eHealth Programs Fail? An Alternative Set of Guiding Principles. PLoS Med. 2010;7(11): e1000360.

Wells S, Tamir O, Gray J, Naidoo D, Bekhit M, Goldmann D. Are quality improvement collaboratives effective? A systematic review. BMJ Qual Saf. 2018;27(3):226–40.

Landon BE, Wilson IB, McInnes K, Landrum MB, Hirschhorn L, Marsden PV, Gustafson D, Cleary PD. Effects of a quality improvement collaborative on the outcome of care of patients with HIV infection: the EQHIV study. Ann Intern Med. 2004;140(11):887–96.

Mittman BS. Creating the evidence base for quality improvement collaboratives. Ann Intern Med. 2004;140(11):897–901.

Wennberg JE. Unwarranted variations in healthcare delivery: implications for academic medical centres. BMJ. 2002;325(7370):961–4.

Bungay H. Cancer and health policy: the postcode lottery of care. Soc Policy Admin. 2005;39(1):35–48.

Wennberg JE, Cooper MM: The Quality of Medical Care in the United States: A Report on the Medicare Program: The Dartmouth Atlas of Health Care 1999: The Center for the Evaluative Clinical Sciences [Internet]. 1999.

DaSilva P, Gray JM. English lessons: can publishing an atlas of variation stimulate the discussion on appropriateness of care? Med J Aust. 2016;205(S10):S5–7.

Gray WK, Day J, Briggs TW, Harrison S. Identifying unwarranted variation in clinical practice between healthcare providers in England: Analysis of administrative data over time for the Getting It Right First Time programme. J Eval Clin Pract. 2021;27(4):743–50.

Wabe N, Thomas J, Scowen C, Eigenstetter A, Lindeman R, Georgiou A. The NSW Pathology Atlas of Variation: Part I—Identifying Emergency Departments With Outlying Laboratory Test-Ordering Practices. Ann Emerg Med. 2021;78(1):150–62.

Jamal A, Babazono A, Li Y, Fujita T, Yoshida S, Kim SA. Elucidating variations in outcomes among older end-stage renal disease patients on hemodialysis in Fukuoka Prefecture, Japan. PLoS ONE. 2021;16(5): e0252196.

Sutherland K, Levesque JF. Unwarranted clinical variation in health care: definitions and proposal of an analytic framework. J Eval Clin Pract. 2020;26(3):687–96.

Tanenbaum SJ. Reducing variation in health care: The rhetorical politics of a policy idea. J Health Polit Policy Law. 2013;38(1):5–26.

Atsma F, Elwyn G, Westert G. Understanding unwarranted variation in clinical practice: a focus on network effects, reflective medicine and learning health systems. Int J Qual Health Care. 2020;32(4):271–4.

Horbar JD, Rogowski J, Plsek PE, Delmore P, Edwards WH, Hocker J, Kantak AD, Lewallen P, Lewis W, Lewit E. Collaborative quality improvement for neonatal intensive care. Pediatrics. 2001;107(1):14–22.

Van Maanen J: Tales of the field: On writing ethnography: University of Chicago Press; 2011.

Golden-Biddle K, Locke K. Appealing work: An investigation of how ethnographic texts convince. Organ Sci. 1993;4(4):595–616.

Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.

Glaser BG. The constant comparative method of qualitative analysis. Soc Probl. 1965;12:436–45.

Willis R. The use of composite narratives to present interview findings. Qual Res. 2019;19(4):471–80.

Vojdani A, Vojdani E, Saidara E, Maes M. Persistent SARS-CoV-2 Infection, EBV, HHV-6 and other factors may contribute to inflammation and autoimmunity in long COVID. Viruses. 2023;15(2):400.

Choutka J, Jansari V, Hornig M, Iwasaki A. Unexplained post-acute infection syndromes. Nat Med. 2022;28(5):911–23.

Connors JM, Ariëns RAS. Uncertainties about the roles of anticoagulation and microclots in postacute sequelae of severe acute respiratory syndrome coronavirus 2 infection. J Thromb Haemost. 2023;21(10):2697–701.

Patel MA, Knauer MJ, Nicholson M, Daley M, Van Nynatten LR, Martin C, Patterson EK, Cepinskas G, Seney SL, Dobretzberger V. Elevated vascular transformation blood biomarkers in Long-COVID indicate angiogenesis as a key pathophysiological mechanism. Mol Med. 2022;28(1):122.

Greenhalgh T, Sivan M, Delaney B, Evans R, Milne R: Long covid—an update for primary care. bmj 2022, 378.

Parkin A, Davison J, Tarrant R, Ross D, Halpin S, Simms A, Salman R, Sivan M. A multidisciplinary NHS COVID-19 service to manage post-COVID-19 syndrome in the community. J Prim Care Commun Health. 2021;12:21501327211010990.

NHS England: COVID-19 Post-Covid Assessment Service, vol. Accessed 5th March 2024 at https://www.england.nhs.uk/statistics/statistical-work-areas/covid-19-post-covid-assessment-service/ . London: NHS England; 2024.

Sivan M, Halpin S, Gee J, Makower S, Parkin A, Ross D, Horton M, O'Connor R: The self-report version and digital format of the COVID-19 Yorkshire Rehabilitation Scale (C19-YRS) for Long Covid or Post-COVID syndrome assessment and monitoring. Adv Clin Neurosci Rehabil 2021;20(3).

The EuroQol Group. EuroQol-a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199–208.

Sivan M, Preston NJ, Parkin A, Makower S, Gee J, Ross D, Tarrant R, Davison J, Halpin S, O’Connor RJ, et al. The modified COVID-19 Yorkshire Rehabilitation Scale (C19-YRSm) patient-reported outcome measure for Long Covid or Post-COVID syndrome. J Med Virol. 2022;94(9):4253–64.

Johns MW. A new method for measuring daytime sleepiness: the Epworth sleepiness scale. Sleep. 1991;14(6):540–5.

Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.

Van Dixhoorn J, Duivenvoorden H. Efficacy of Nijmegen Questionnaire in recognition of the hyperventilation syndrome. J Psychosom Res. 1985;29(2):199–206.

Evans R, Pick A, Lardner R, Masey V, Smith N, Greenhalgh T: Breathing difficulties after covid-19: a guide for primary care. BMJ 2023;381.

Van Dixhoorn J, Folgering H: The Nijmegen Questionnaire and dysfunctional breathing. In . , vol. 1: Eur Respiratory Soc; 2015.

Courtney R, Greenwood KM. Preliminary investigation of a measure of dysfunctional breathing symptoms: The Self Evaluation of Breathing Questionnaire (SEBQ). Int J Osteopathic Med. 2009;12(4):121–7.

Espinosa-Gonzalez A, Master H, Gall N, Halpin S, Rogers N, Greenhalgh T. Orthostatic tachycardia after covid-19. BMJ (Clinical Research ed). 2023;380:e073488–e073488.

PubMed Google Scholar

Bungo M, Charles J, Johnson P Jr. Cardiovascular deconditioning during space flight and the use of saline as a countermeasure to orthostatic intolerance. Aviat Space Environ Med. 1985;56(10):985–90.

CAS PubMed Google Scholar

Sivan M, Corrado J, Mathias C. The Adapted Autonomic Profile (Aap) Home-Based Test for the Evaluation of Neuro-Cardiovascular Autonomic Dysfunction. Adv Clin Neurosci Rehabil. 2022;3:10–13. https://doi.org/10.47795/QKBU46715 .

Lee C, Greenwood DC, Master H, Balasundaram K, Williams P, Scott JT, Wood C, Cooper R, Darbyshire JL, Gonzalez AE. Prevalence of orthostatic intolerance in long covid clinic patients and healthy volunteers: A multicenter study. J Med Virol. 2024;96(3): e29486.

World Health Organization: Clinical management of covid-19 - living guideline. Geneva: WHO. Accessed 4th October 2023 at https://www.who.int/publications/i/item/WHO-2019-nCoV-clinical-2021-2 ; 2023.

Ahmed I, Mustafaoglu R, Yeldan I, Yasaci Z, Erhan B: Effect of pulmonary rehabilitation approaches on dyspnea, exercise capacity, fatigue, lung functions and quality of life in patients with COVID-19: A Systematic Review and Meta-Analysis. Arch Phys Med Rehabil 2022.

Dillen H, Bekkering G, Gijsbers S, Vande Weygaerde Y, Van Herck M, Haesevoets S, Bos DAG, Li A, Janssens W, Gosselink R, et al. Clinical effectiveness of rehabilitation in ambulatory care for patients with persisting symptoms after COVID-19: a systematic review. BMC Infect Dis. 2023;23(1):419.

Learmonth Y, Dlugonski D, Pilutti L, Sandroff B, Klaren R, Motl R. Psychometric properties of the fatigue severity scale and the modified fatigue impact scale. J Neurol Sci. 2013;331(1–2):102–7.

Webster K, Cella D, Yost K. The Functional Assessment of Chronic Illness T herapy (FACIT) Measurement System: properties, applications, and interpretation. Health Qual Life Outcomes. 2003;1(1):1–7.

Mundt JC, Marks IM, Shear MK, Greist JM. The Work and Social Adjustment Scale: a simple measure of impairment in functioning. Br J Psychiatry. 2002;180(5):461–4.

Chalder T, Berelowitz G, Pawlikowska T, Watts L, Wessely S, Wright D, Wallace E. Development of a fatigue scale. J Psychosom Res. 1993;37(2):147–53.

Shahid A, Wilkinson K, Marcu S, Shapiro CM: Visual analogue scale to evaluate fatigue severity (VAS-F). In: STOP, THAT and one hundred other sleep scales . edn.: Springer; 2011:399–402.

Parker M, Sawant HB, Flannery T, Tarrant R, Shardha J, Bannister R, Ross D, Halpin S, Greenwood DC, Sivan M. Effect of using a structured pacing protocol on post-exertional symptom exacerbation and health status in a longitudinal cohort with the post-COVID-19 syndrome. J Med Virol. 2023;95(1): e28373.

Kenny RA, Bayliss J, Ingram A, Sutton R. Head-up tilt: a useful test for investigating unexplained syncope. The Lancet. 1986;327(8494):1352–5.

Drury MOC: Science and Psychology. In: The selected writings of Maurice O’Connor Drury: On Wittgenstein, philosophy, religion and psychiatry. edn.: Bloomsbury Publishing; 2017.

Concato J, Shah N, Horwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med. 2000;342(25):1887–92.

Mongtomery K: How doctors think: Clinical judgment and the practice of medicine: Oxford University Press; 2005.

Download references

Acknowledgements

We are grateful to clinic staff for allowing us to study their work and to patients for allowing us to sit in on their consultations. We also thank the funder of LOCOMOTION (National Institute for Health Research) and the patient advisory group for lived experience input.

This research is supported by National Institute for Health Research (NIHR) Long Covid Research Scheme grant (Ref COV-LT-0016).

Author information

Authors and affiliations.

Nuffield Department of Primary Care Health Sciences, University of Oxford, Woodstock Rd, Oxford, OX2 6GG, UK

Trisha Greenhalgh, Julie L. Darbyshire & Emma Ladds

Imperial College Healthcare NHS Trust, London, UK

LOCOMOTION Patient Advisory Group and Lived Experience Representative, London, UK

You can also search for this author in PubMed Google Scholar

Contributions

TG conceptualized the overall study, led the empirical work, supported the quality improvement meetings, conducted the ethnographic visits, led the data analysis, developed the theorization and wrote the first draft of the paper. JLD organized and led the quality improvement meetings, supported site-based researchers to collect and analyse data on their clinic, collated and summarized data on quality topics, and liaised with the patient advisory group. CL conceptualized and led the quality topic on POTS, including exploring reasons for some clinics’ reluctance to conduct testing and collating and analysing the NASA Lean Test data across all sites. EL assisted with ethnographic visits, data analysis, and theorization. JCS contributed lived experience of long covid and also clinical experience as an occupational therapist; she liaised with the wider patient advisory group, whose independent (patient-led) audit of long covid clinics informed the quality improvement prioritization exercise. All authors provided extensive feedback on drafts and contributed to discussions and refinements. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Trisha Greenhalgh .

Ethics declarations

Ethics approval and consent to participate.

LOng COvid Multidisciplinary consortium Optimising Treatments and servIces acrOss the NHS study is sponsored by the University of Leeds and approved by Yorkshire & The Humber—Bradford Leeds Research Ethics Committee (ref: 21/YH/0276) and subsequent amendments.

Patient participants in clinic were approached by the clinician (without the researcher present) and gave verbal informed consent for a clinically qualified researcher to observe the consultation. If they consented, the researcher was then invited to sit in. A written record was made in field notes of this verbal consent. It was impractical to seek consent from patients whose cases were discussed (usually with very brief clinical details) in online MDTs. Therefore, clinical case examples from MDTs presented in the paper are fictionalized cases constructed from multiple real cases and with key clinical details changed (for example, comorbidities were replaced with different conditions which would produce similar symptoms). All fictionalized cases were checked by our patient advisory group to check that they were plausible to lived experience experts.

Consent for publication

No direct patient cases are reported in this manuscript. For details of how the fictionalized cases were constructed and validated, see “Consent to participate” above.

Competing interests

TG was a member of the UK National Long Covid Task Force 2021–2023 and on the Oversight Group for the NICE Guideline on Long Covid 2021–2022. She is a member of Independent SAGE.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Greenhalgh, T., Darbyshire, J.L., Lee, C. et al. What is quality in long covid care? Lessons from a national quality improvement collaborative and multi-site ethnography. BMC Med 22 , 159 (2024). https://doi.org/10.1186/s12916-024-03371-6

Download citation

Received : 04 December 2023

Accepted : 26 March 2024

Published : 15 April 2024

DOI : https://doi.org/10.1186/s12916-024-03371-6

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Post-covid-19 syndrome
Quality improvement
Breakthrough collaboratives
Warranted variation
Unwarranted variation
Improvement science
Ethnography
Idiographic reasoning
Nomothetic reasoning

BMC Medicine

ISSN: 1741-7015

Submission enquiries: [email protected]
General enquiries: [email protected]

Rainstorms impacts on water, sediment, and trace elements loads in an urbanized catchment within Moscow city: case study of summer 2020 and 2021

Published: 07 December 2022
Volume 151 , pages 871–889, ( 2023 )

Cite this article

Sergey Chalov ORCID: orcid.org/0000-0002-6937-7020 1 , 2 ,
Vladimir Platonov 1 ,
Oxana Erina 1 ,
Vsevolod Moreido 1 , 3 ,
Mikhail Samokhin 1 ,
Dmitriy Sokolov 1 ,
Maria Tereshina 1 ,
Yulia Yarinich 1 &
Nikolay Kasimov 1

337 Accesses

7 Altmetric

Explore all metrics

In 2020 and 2021, the city of Moscow, Russia, has experienced two historical rainfall events that had caused major flooding of small rivers. Based on long-term observation datasets from the surrounding weather stations, regional mesoscale COSMO-CLM climate model results, and a detailed hydrological and water quality monitoring data, we performed a pioneer assessment of climate change and urbanization impact on flooding hazard and water quality of the urban Setun River as a case study. Statistically significant rise of some moderate ETCCDI climate change indices (R20mm and R95pTOT) was revealed for the 1966–2020 period, while no significant trends were observed for more extreme indices. The combined impact of climate change and increased urbanization is highly non-linear and results in as much as a fourfold increase in frequency of extreme floods and shift of water regime features which lead to formation of specific seasonal flow patterns. The rainstorm flood wave response time, involving infiltrated and hillslope-routed fraction of rainfall, is accounted as 6 to 11 h, which is more than twice as rapid as compared to the non-urbanized nearby catchments. Based on temporal trends before and after rainfall flood peak, four groups of dissolved chemicals were identified: soluble elements whose concentrations decrease with an increase in water discharge; mostly insoluble and well-sorted elements whose concentrations increase with discharge (Mn, Cs, Cd, Al); elements negatively related to water discharge during flood events (Li, B, Cr, As, Br and Sr); and a wide range of dissolved elements (Cu, Zn, Mo, Sn, Pb, Ba, La, Cs, U) which concentrations remain stable during rainfall floods. Our study identifies that lack of research focused on the combined impacts of climate change and urbanization on flooding and water quality in the Moscow urban area is a key problem in water management advances.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

The effects of climate variability and land-use change on streamflow and nutrient loadings in the Sesan, Sekong, and Srepok (3S) River Basin of the Lower Mekong Basin

Dao Nguyen Khoi, Pham Thi Loi, … Pham Thi Thao Nhi

Influence of Diverse Urban Pressures on Water Characteristics in a Small Eastern Mediterranean Watershed

E. Maatouk, A. El Samrani, … Z. Matar

Data availability

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Code availability

Not applicable.

Ahammed F (2017) A review of water-sensitive urban design technologies and practices for sustainable stormwater management. Sustain Water Resour Manag 33(3):269–282. https://doi.org/10.1007/S40899-017-0093-8

Article Google Scholar

Alekseeva AA, Bukharov VM, Losev VM (2022) The convective storm in the Moscow Region on June 28, 2021. Hydrometeorol Res Forecast 1:22–42. (in Russian) https://doi.org/10.37162/2618-9631-2022-1-22-42

Aleshina MA, Semenov VA, Chernokulsky AV (2021) A link between surface air temperature and extreme precipitation over Russia from station and reanalysis data. Environ Res Lett 16:105004. https://doi.org/10.1088/1748-9326/ac1cba

Arakawa A, Lamb VR (1977) Computational design of the basic dynamical processes of the UCLA general circulation model. In: Chang J (ed) Methods in Computational Physics: Advances in Research and Applications, Vol 17: General Circulation Models of the Atmosphere. Academic Press, Oxford, pp 173–265. https://doi.org/10.1016/B978-0-12-460817-7.50009-4

Ashley RM, Balmfort DJ, Saul AJ, Blanskby JD (2005) Flooding in the future - Predicting climate change, risks and responses in urban areas. Water Sci Technol 52(5):265–273. https://doi.org/10.2166/wst.2005.0142

Barbosa AE, Fernandes JN, David LM (2012) Key issues for sustainable urban stormwater management. Water Res 46:6787–6798. https://doi.org/10.1016/J.WATRES.2012.05.029

Bedan ES, Clausen JC (2009) Stormwater runoff quality and quantity from traditional and low impact development watersheds. J Am Water Resour Assoc 45:998–1008. https://doi.org/10.1111/J.1752-1688.2009.00342.X

Bohman A, Glaas E, Karlson M (2020) Integrating Sustainable Stormwater Management in Urban Planning: Ways Forward towards Institutional Change and Collaborative Action. Water 12:203. https://doi.org/10.3390/W12010203

Brown RR, Keath N, Wong THF (2009) Urban water management in cities: historical, current and future regimes. Water Sci Technol 59:847–855. https://doi.org/10.2166/WST.2009.029

Cettner A, Ashley R, Viklander M, Nilsson K (2013) Stormwater management and urban planning: Lessons from 40 years of innovation. J Environ Plan Manag 56:786–801. https://doi.org/10.1080/09640568.2012.706216

Chernokulsky A, Kozlov F, Zolina O et al (2019) Observed changes in convective and stratiform precipitation in Northern Eurasia over the last five decades. Environ Res Lett 14:045001. https://doi.org/10.1088/1748-9326/AAFB82

Chubarova N, Smirnov A, Holben B (2011) Aerosol properties in Moscow according to 10 years of AERONET measurements at the meteorological observatory of Moscow State University. Geogr Environ Sustain 4(1):19–32. https://doi.org/10.24057/2071-9388-2011-4-1-19-32

Contractor S, Donat MG, Alexander LV (2021) Changes in observed daily precipitation over global land areas since 1950. J Clim 34:3–19. https://doi.org/10.1175/JCLI-D-19-0965.1

Damodaram C, Giacomoni MH, Prakash Khedun C et al (2010) Simulation of combined best management practices and low impact development for sustainable stormwater management1. J Am Water Resour Assoc 46:907–918. https://doi.org/10.1111/J.1752-1688.2010.00462.X

Darnthamrongkul W, Mozingo LA (2021) Toward sustainable stormwater management: Understanding public appreciation and recognition of urban Low Impact Development (LID) in the San Francisco Bay Area. J Environ Manage 300:113716. https://doi.org/10.1016/J.JENVMAN.2021.113716

Donat MG, Lowry AL, Alexander LV et al (2016) More extreme precipitation in the world’s dry and wet regions. Nat Clim Chang 6:508–513. https://doi.org/10.1038/nclimate2941

Erina O, Tereshina M, Shinkareva G et al (2021) Natural background and transformation of water quality in the Moskva River. IOP Conf Ser Earth Environ Sci 834:12055. https://doi.org/10.1088/1755-1315/834/1/012055

Erina O, Sokolov D, Tereshina M et al (2020) Seasonal dynamics of nutrients and organic matter in urban stream. E3S Web Conf 163:03004. https://doi.org/10.1051/e3sconf/202016303004

Faccini F, Luino F, Sacchini A et al (2015) Geohydrological hazards and urban development in the Mediterranean area: An example from Genoa (Liguria, Italy). Nat Hazards Earth Syst Sci 15:2631–2652. https://doi.org/10.5194/NHESS-15-2631-2015

Gal-Chen T, Somerville RCJ (1975) On the use of a coordinate transformation for the solution of the Navier-Stokes equations. J Comput Phys 17:209–228. https://doi.org/10.1016/0021-9991(75)90037-6

Gasperi J, Zgheib S, Cladière M et al (2012) Priority pollutants in urban stormwater: part 2 – case of combined sewers. Water Res 46:6693–6703. https://doi.org/10.1016/J.WATRES.2011.09.041

Goulden S, Portman ME, Carmon N, Alon-Mozes T (2018) From conventional drainage to sustainable stormwater management: Beyond the technical challenges. J Environ Manage 219:37–45. https://doi.org/10.1016/J.JENVMAN.2018.04.066

Groisman PY, Knight RW, Easterling DR et al (2005) Trends in intense precipitation in the climate record. J Clim 18:1326–1350. https://doi.org/10.1175/JCLI3339.1

Hale RL (2016) Spatial and temporal variation in local stormwater infrastructure use and stormwater management paradigms over the 20th century. Water 8:310. https://doi.org/10.3390/W8070310

Hersbach H, Bell B, Berrisford P et al (2020) The ERA5 global reanalysis. Q J R Meteorol Soc 146:1999–2049. https://doi.org/10.1002/qj.3803

Herzog HJ, Vogel G, Schubert U (2002) LLM – a nonhydrostatic model applied to high-resolving simulations of turbulent fluxes over heterogeneous terrain. Theor Appl Climatol 731(73):67–86. https://doi.org/10.1007/S00704-002-0694-4

Karl TR, Nicholls N, Ghazi A (1999) CLIVAR/GCOS/WMO Workshop on Indices and Indicators for Climate Extremes Workshop Summary. Weather and Climate Extremes. Springer, Dordrecht, pp 3–7

Chapter Google Scholar

Klimanova OA, Illarionova OI (2020) Green infrastructure indicators for urban planning: applying the integrated approach for Russian largest cities. Geogr Environ Sustain 13:251–259. https://doi.org/10.24057/2071-9388-2019-123

Kosheleva NE, Vlasov DV, Timofeev IV et al (2022) Benzo[a]pyrene in Moscow road dust: pollution levels and health risks. Environ Geochem Health. https://doi.org/10.1007/s10653-022-01287-9

Lappalainen HK, Altimir N, Kerminen V-M et al (2018) Pan-Eurasian Experiment (PEEX) Program: an overview of the first 5 years in operation and future prospects. Geogr Environ Sustain 11:6–19. https://doi.org/10.24057/2071-9388-2018-11-1-6-19

Lappalainen HK, Petäjä T, Vihma T et al (2022) Overview: Recent advances in the understanding of the northern Eurasian environments and of the urban air quality in China – a Pan-Eurasian Experiment (PEEX) programme perspective. Atmos Chem Phys 22:4413–4469. https://doi.org/10.5194/acp-22-4413-2022

Lee JH, Bang KW (2000) Characterization of urban stormwater runoff. Water Res 34:1773–1780. https://doi.org/10.1016/S0043-1354(99)00325-5

Liang P, Ding Y (2017) The long-term variation of extreme heavy precipitation and its link to urbanization effects in Shanghai during 1916–2014. Adv Atmos Sci 34:321–334. https://doi.org/10.1007/s00376-016-6120-0

Lu J, Liu J, Fu X, Wang J (2021) Stormwater hydrographs simulated for different structures of urban drainage network: dendritic and looped sewer networks. Urban Water J 18:522–529. https://doi.org/10.1080/1573062X.2021.1893369

Maragno D, Gaglio M, Robbi M et al (2018) Fine-scale analysis of urban flooding reduction from green infrastructure: An ecosystem services approach for the management of water flows. Ecol Modell 386:1–10. https://doi.org/10.1016/j.ecolmodel.2018.08.002

Masson V, Lemonsu A, Hidalgo J, Voogt J (2020) Urban climates and climate change. Annu Rev Environ Resour 45:411–444

McPhillips LE, Matsler M, Rosenzweig BR, Kim Y (2021) What is the role of green stormwater infrastructure in managing extreme precipitation events? Sustain Resilient Infrastruct 6:133–142. https://doi.org/10.1080/23789689.2020.1754625

Miller JD, Hutchins M (2017) The impacts of urbanisation and climate change on urban flooding and urban water quality: A review of the evidence concerning the United Kingdom. J Hydrol Reg Stud 12:345–362. https://doi.org/10.1016/j.ejrh.2017.06.006

Mokhov II, Roekner E, Semenov VA, Khon VC (2005) Extreme precipitation regimes in Northern Eurasia in the 20th century and their possible changes in the 21st century. Dokl Earth Sci 403:767–770

Google Scholar

Nikiforova EM, Kasimov NS, Kosheleva NE, Timofeev IV (2022) Main features and contamination of sealed soils in the east of Moscow city. Environ Geochem Health 44:1697–1711. https://doi.org/10.1007/s10653-021-01132-5

Popovicheva O, Chichaeva M, Kovach R et al (2022) Seasonal, weekly, and diurnal black carbon in moscow megacity background under impact of urban and regional sources. Atmos 13(4):563. https://doi.org/10.3390/atmos13040563

Praskievicz S, Chang H (2009) A review of hydrological modelling of basin-scale climate change and urban development impacts. Prog Phys Geogr 33:650–671. https://doi.org/10.1177/0309133309348098

Prudencio L, Null SE (2018) Stormwater management and ecosystem services: a review. Environ Res Lett 13:033002. https://doi.org/10.1088/1748-9326/AAA81A

Qiao XJ, Liu L, Kristoffersson A, Randrup TB (2019) Governance factors of sustainable stormwater management: A study of case cities in China and Sweden. J Environ Manag 248:109249. https://doi.org/10.1016/J.JENVMAN.2019.07.020

Qiao XJ, Liao KH, Randrup TB (2020) Sustainable stormwater management: a qualitative case study of the Sponge Cities initiative in China. Sustain Cities Soc 53:101963. https://doi.org/10.1016/J.SCS.2019.101963

Ritter B, Geleyn J-F (1992) A comprehensive radiation scheme for numerical weather prediction models with potential applications in climate simulations. Mon Weather Rev 120:303–325. https://doi.org/10.1175/1520-0493(1992)120%3c0303:ACRSFN%3e2.0.CO;2

Rockel B, Will A, Hense A (2008) The Regional Climate Model COSMO-CLM (CCLM). Meteorol Zeitschrift 17:347–348. https://doi.org/10.1127/0941-2948/2008/0309

Rosenberger L, Leandro J, Pauleit S, Erlwein S (2021) Sustainable stormwater management under the impact of climate change and urban densification. J Hydrol 596:126137. https://doi.org/10.1016/J.JHYDROL.2021.126137

Schär C, Leuenberger D, Fuhrer O et al (2002) A new terrain-following vertical coordinate formulation for atmospheric prediction models. Mon Weather Rev 130:2459–2480. https://doi.org/10.1175/1520-0493(2002)130%3c2459:ANTFVC%3e2.0.CO;2

Schubert-Frisius M, Feser F, von Storch H, Rast S (2017) Optimal spectral nudging for global dynamic downscaling. Mon Weather Rev 145:909–927. https://doi.org/10.1175/MWR-D-16-0036.1

Schulz JP, Vogel G (2020) Improving the processes in the land surface scheme TERRA: Bare soil evaporation and skin temperature. Atmosphere (basel) 11:1–17. https://doi.org/10.3390/atmos11050513

Semenov V, Bengtsson L (2002) Secular trends in daily precipitation characteristics: greenhouse gas simulation with a coupled AOGCM. Clim Dyn 19:123–140. https://doi.org/10.1007/S00382-001-0218-4

Sokolov D, Chalov S, Tereshina M et al (2021) Hydrological regime of the urban Setun River. IOP Conf Ser Earth Environ Sci 834:12024. https://doi.org/10.1088/1755-1315/834/1/012024

Sokolov D, Erina O, Tereshina M, Chalov S (2020) Human impact on organic matter distribution in the Moskva River. E3S Web Conf 163:05013. https://doi.org/10.1051/e3sconf/202016305013

Tereshina M, Erina O, Sokolov D et al (2021) Longitudinal patterns of different pollutant concentrations in the Setun River. IOP Conf Ser Earth Environ Sci 834:12051. https://doi.org/10.1088/1755-1315/834/1/012051

Tereshina M, Erina O, Sokolov D et al (2020) Nutrient dynamics along the Moskva River under heavy pollution and limited self-purification capacity. E3S Web Conf 163:05014. https://doi.org/10.1051/e3sconf/202016305014

Tiedtke M (1989) A comprehensive mass flux scheme for cumulus parameterization in large-scale models. Mon Weather Rev 117:1779–1800. https://doi.org/10.1175/1520-0493(1989)117%3c1779:ACMFSF%3e2.0.CO;2

Trenberth KE (2011) Changes in precipitation with climate change. Clim Res 47:123–138. https://doi.org/10.3354/CR00953

Varentsov M, Wouters H, Platonov V, Konstantinov P (2018) Megacity-induced mesoclimatic effects in the lower atmosphere: a modeling study for multiple summers over Moscow. Russia Atmosphere (basel) 9:50. https://doi.org/10.3390/atmos9020050

Varentsov M, Samsonov T, Demuzere M (2020) Impact of urban canopy parameters on a megacity’s modelled thermal environment. Atmosphere (basel) 11:1–31. https://doi.org/10.3390/atmos11121349

Vlasov D, Eremina I, Shinkareva G et al (2021) Daily variations in wet deposition and washout rates of potentially toxic elements in Moscow during spring season. Geogr Environ Sustain 14:219–233. https://doi.org/10.24057/2071-9388-2020-162

Vlasov D, Kasimov N, Eremina I et al (2021) Partitioning and solubilities of metals and metalloids in spring rains in Moscow megacity. Atmos Pollut Res 12:255–271. https://doi.org/10.1016/j.apr.2020.09.012

Vlasov D, Kosheleva N, Kasimov N (2021) Spatial distribution and sources of potentially toxic elements in road dust and its PM10 fraction of Moscow megacity. Sci Total Environ 761:143267. https://doi.org/10.1016/j.scitotenv.2020.143267

Vlasov D, Vasil’chuk J, Kosheleva N, Kasimov N (2020) Dissolved and suspended forms of metals and metalloids in snow cover of megacity: partitioning and deposition rates in western Moscow. Atmos. 11

Voevodin VV, Antonov AS, Nikitenko DA et al (2019) Supercomputer Lomonosov-2: large scale, deep monitoring and fine analytics for the user community. Supercomput Front Innov 6:4–11. https://doi.org/10.14529/JSFI190201

Vorobevskii I, Al JF, Schneebeck F et al (2020) Urban floods: linking the overloading of a storm water sewer system to precipitation parameters. Hydrology 7:35. https://doi.org/10.3390/HYDROLOGY7020035

Walling DE, Collins AL, Stroud RW (2008) Tracing suspended sediment and particulate phosphorus sources in catchments. J Hydrol 350:274–289. https://doi.org/10.1016/j.jhydrol.2007.10.047

Wouters H, Demuzere M, Blahak U et al (2016) The efficient urban canopy dependency parametrization (SURY) v1.0 for atmospheric modelling: Description and application with the COSMO-CLM model for a Belgian summer. Geosci Model Dev 9:3027–3054. https://doi.org/10.5194/gmd-9-3027-2016

Wouters H, Demuzere M, Ridder K De, van Lipzig NPM (2015) The impact of impervious water-storage parametrization on urban climate modelling. Urban Clim 11:24–50. https://doi.org/10.1016/j.uclim.2014.11.005

Yang L, Smith JA, Wright DB et al (2013) Urbanization and Climate Change: An Examination of Nonstationarities in Urban Flooding. J Hydrometeorol 14:1791–1809. https://doi.org/10.1175/JHM-D-12-095.1

Ye H, Fetzer EJ, Wong S, Lambrigtson BH (2017) Rapid decadal convective precipitation increase over Eurasia during the last three decades of the 20th century. Sci Adv 3:e1600944. https://doi.org/10.1126/sciadv.1600944

Zhou X, Bai Z, Yang Y (2017) Linking trends in urban extreme rainfall to urban flooding in China. Int J Climatol 37:4586–4593. https://doi.org/10.1002/joc.5107

Zolina OG, Bulygina ON (2016) Current climatic variability of extreme precipitation in Russia. Fundam Appl Climatol 1:84–103. https://doi.org/10.21513/2410-8758-2016-1-84-103

Download references

Field studies were supported by Russian Science Foundation project 19–77-30004. The analytical experiments were done under Ministry of Science and Higher Education of Russian Federation project 075–15-2021–574. COSMO-CLM model setup is a part of RFBR project 21–55-53039. The methodology of this study is developed under the Interdisciplinary Scientific and Educational School of Lomonosov Moscow State University «Future Planet and Global Environmental Change» and Kazan Federal University Strategic Academic Leadership Program (“PRIORITY-2030”). The research is carried out using the equipment of the shared research facilities of HPC computing resources at Lomonosov Moscow State University. Streamflow patterns analysis was carried out under Governmental Order to Water Problems Institute, Russian Academy of Sciences, subject no. FMWZ-2022–0003, project 3.7.

Author information

Authors and affiliations.

Faculty of Geography, Lomonosov Moscow State University, Leninskie Gory, 1, 119991 GSP-1, Moscow, Russia

Sergey Chalov, Vladimir Platonov, Oxana Erina, Vsevolod Moreido, Mikhail Samokhin, Dmitriy Sokolov, Maria Tereshina, Yulia Yarinich & Nikolay Kasimov

Kazan Federal University, Kremlevskaya St., 18, 420008, Kazan, Russia

Sergey Chalov

Institute of Water Problems of the Russian Academy of Sciences, Gubkina Str., 3, 119333, Moscow, Russia

Vsevolod Moreido

You can also search for this author in PubMed Google Scholar

Contributions

Conceptualization, original draft preparation—Sergey Chalov; numerical experiments conducting and evaluation, precipitation data analysis, writing—Vladimir Platonov; the rainfall-runoff patterns analysis—Vsevolod Moreido; methodology, validation, writing—Oxana Erina, Dmitriy Sokolov, Maria Tereshina, Mikhail Samokhin; precipitation data preparation and visualization—Yulia Yarinich; review, editing—Nikolay Kasimov. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to Sergey Chalov .

Ethics declarations

Ethics approval, consent to participate, consent for publication, competing interests.

The authors declare no competing interests.

Conflict of interest

Additional information, publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (PDF 714 KB)

Supplementary file2 (pdf 824 kb), supplementary file3 (pdf 112 kb), supplementary file4 (pdf 488 kb), supplementary file5 (pdf 668 kb), rights and permissions.

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Chalov, S., Platonov, V., Erina, O. et al. Rainstorms impacts on water, sediment, and trace elements loads in an urbanized catchment within Moscow city: case study of summer 2020 and 2021. Theor Appl Climatol 151 , 871–889 (2023). https://doi.org/10.1007/s00704-022-04298-9

Download citation

Received : 31 August 2022

Accepted : 23 November 2022

Published : 07 December 2022

Issue Date : January 2023

DOI : https://doi.org/10.1007/s00704-022-04298-9

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Find a journal
Publish with us
Track your research

IMAGES

PPT
Quality at Honda
Customers
Honda Case Study
Quality at Honda
Quality at Honda

VIDEO

Unboxing Honda Interface Module & Diagnostics System
Honda Demonstrates Prototype Road Condition Monitoring System
GROUP 5: Quality Service Management, Chapter 1
Short Story: The Honda Effect
CIMA Management Case Study (MCS) Feb 2024 (Cuppcar)
Video 32

COMMENTS

PDF Quality 120
global quality management system is essential to ensure that all Honda facilities continue to generate 120% product quality. G-HQS established in April 2005 serves as the foundation of this. G-HQS is a set of fundamental standards supporting quality assurance and improvement activities in all domains based on Honda's Quality Cycle. The aim is ...
PDF Aiming for 120% products quality Implementing the Global Honda Quality
product quality. To address this need, Honda established the Global Honda Quality Standard (G-HQS) in April 2005. Based on the ISO 9001*1 and ISO/TS 16949*2 standards under which Honda facilities in Japan and around the world have been or are to be certified, the G-HQS serves to communicate the considerable knowledge Honda has gathered in ...
Case study: Honda of America manufacturing, Inc.: Can lean production
title = "Case study: Honda of America manufacturing, Inc.: Can lean production practices increase environmental performance?", abstract = "This article covers the strategic, organizational, and operational decisions involved in one automobile manufacturer's efforts to balance its goals of productivity and high quality with the more elusive goal ...
Lessons from Honda's Early Adaptive Strategy
Lessons from Honda's Early Adaptive Strategy. My last post talked about how a little-known company, Grace Manufacturing, took a flexible and opportunistic approach to its strategy when its core ...
(PDF) Case study: Honda of America Manufacturing, Inc.: Can lean
Case Study: Honda of America Manufacturing, Inc. ENVIRONMENTAL QUALITY MANAGI,MENT / Autumn 1998 / 57 groups, including National Resources De- fense Council and Greenpeace, took an in-
Strategic Vision 2021 Quality Survey Puts Honda On Top
The Honda Accord Hybrid, one of five segment winners in the 2021 Total Quality Index study. According to Strategic Vision, "The Honda Accord generates more love than the [Toyota] Camry on all ...
Total quality management: three case studies from around the world
According to Teresa Whitacre, of international consulting firm ASQ, proper quality management also boosts a company's profitability. "Total quality management allows the company to look at their management system as a whole entity — not just an output of the quality department," she says. "Total quality means the organisation looks at ...
The Key Success Factor: A Study of Honda Motor
This paper is to study how Honda Motor Company drives t he organization towards. success to improve their competitiveness with the best performance by its management. Honda is a production company ...
Case Studies
Using DMAIC to Improve Nursing Shift-Change Assignments. In this case study involving an anonymous hospital, nursing department leaders sought to improve efficiency of their staff's shift change assignments. Upon value stream mapping the process, team members identified the shift nursing report took 43 minutes on average to complete.
Total Quality Management Approaches Honda Vs Ford.docx
management research field. It is one of the most applied and well accepted approaches for business excellence besides Continuous Quality Improvement (CQI), Six Sigma, Just-in-Time (JIT), and Supply Chain Management (SCM) approaches. There is a great enthusiasm among manufacturing and service industries in adopting and implementing this strategy ...
Design & Quality Concerns at Honda Motors|Operations|Case Study|Case
Keywords. The case is about design and quality issues at Japanese multinational corporation Honda Motors Co. Ltd. (Honda Motors). The case examines in detail Honda Motors' journey as the world's leading automobile company and the problems it later faced. The case discusses the factors that led the company into trouble.
HONDA MOTOR COMPANY
Honda's global expansion strategy is a case study in itself! Let's uncover how they managed to conquer international markets. Local Production: Honda understood the importance of localised production.
In-Depth Case Study: Marketing Strategy of Honda
Honda is one of the largest manufacturers of automobiles and motorcycles in the world. It is a Japanese multinational company that operates in North America, Asia, and Europe. It is also known for the manufacture of aircraft and power equipment. Honda has been the largest manufacturer of motorcycles since 1959.
Honda Motor Company
This case Honda Motor Company focus on Honda ranked highest in a customer satisfaction survey in 2009 for its after sales service and for being one-stop shop for all accessories (dealership store). However, in the used-car consumers' customer satisfaction survey, it ranked only fifth. Meanwhile, after the launch of its new car Jazz, Honda claims that more than 80% of its customers are highly ...
PDF Integral Index of Tra c Planning: Case-Study of Moscow City's
routes was used in subindexes 2 and 3, respectively, and allows to consider the special case of Moscow radial-ring road structure. The signiﬁcance of road accidents was considered in subindex 4. 1.1. Subindex 1. Tra c Management E ciency Subindex 1 describes the tra c management e ciency. It shows how many vehicles a city can
PDF Quality Initiatives
Honda's quality initiatives for delivering new levels of outstanding quality As Honda's production and parts and materials sourcing expand globally, a shared global quality assurance standard is essential to ensuring that all Honda facilities continue to support 120% product quality. To address this need, Honda established the Global Honda ...
PDF Moscow Case Study v2-s
Objectives. The estimation of the current status of Moscow as a Smart City. The identification of current weaknesses in Moscow's smart strategy for the benefit of future planning. The identification of new directions for Smart City development based on expert opinions. Determining the most efficient way to share best practices in the Smart ...
Integral Index of Traffic Planning: Case-Study of Moscow City's
The Integral TP Index was calculated for years 2 012-2017. It clearly illustrates the dynamics of. subindexes presented earlier and allows us to conc lude about the transportation planning in ...
What is quality in long covid care? Lessons from a national quality
Long covid (post covid-19 condition) is a complex condition with diverse manifestations, uncertain prognosis and wide variation in current approaches to management. There have been calls for formal quality standards to reduce a so-called "postcode lottery" of care. The original aim of this study—to examine the nature of quality in long covid care and reduce unwarranted variation in ...
PDF Editorial Honda •Assurance Contents Strategy 1 2 3 4 5 6 Policy Top
Global Management Quality Management Education Honda offers quality management training based on in-house qualifications and the level of quality control responsibilities with the aim of improving associates' quality assurance skills. In Japan, Honda offers a training curriculum with four courses divided into basic training and specialized ...
Rainstorms impacts on water, sediment, and trace elements ...
In 2020 and 2021, the city of Moscow, Russia, has experienced two historical rainfall events that had caused major flooding of small rivers. Based on long-term observation datasets from the surrounding weather stations, regional mesoscale COSMO-CLM climate model results, and a detailed hydrological and water quality monitoring data, we performed a pioneer assessment of climate change and ...
PDF Supply Chain 28
Honda is working to improve transportation efficiency in the shipping of vehicles and equipment, parts shipped between plants, parts for services and repairs, and parts collected from suppliers. In addition to this, in FY2017 the Company commenced management of CO2 emissions in the transportation of automobile production parts,

Case study: Honda of America manufacturing, Inc.: Can lean production practices increase environmental performance?

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Lessons from Honda’s Early Adaptive Strategy

Partner Center

Strategic Vision 2021 Quality Survey Puts Honda On Top

What TQI Measures

Measured: Things Gone Wrong, Owner Perceptions

Triple Winners: Kia, Mercedes-Benz

Top Brands by Price: Honda, Mini, Genesis, Lexus, Porsche

Toyota: Reliability, Durability; Not Always the Best Product

You May Also Like

Sign up for the newsletter

Total quality management: three case studies from around the world

AtlantiCare in numbers

SCGC in numbers

RIMS in numbers

Contributors

Related Papers

RELATED PAPERS

RELATED TOPICS

Search Case Studies

Design & Quality Concerns at Honda Motors

What is quality in long covid care? Lessons from a national quality improvement collaborative and multi-site ethnography

Study registration

Quality improvement collaboratives

Warranted and unwarranted variation in clinical practice

Research question, aims and objectives

The LOCOMOTION study

Setting up the quality improvement collaborative

How evidence-informed quality targets were set

Adding an ethnographic component

Data management and analysis

Member checking

Overview of dataset

“Best practice” in long covid: uncertainty and conflict

Long covid clinics: a heterogeneous context for quality improvement

The patient experience

Example quality topic 1: Outcome measures

Example quality topic 2: Postural orthostatic tachycardia syndrome (POTS)

Example quality topic 3: Management of fatigue

Pursuing local quality improvement through MDTs

Summary of key findings

Strengths and limitations of this study

Explaining variation in long covid care

Nomothetic versus idiographic knowledge

Conclusions

Availability of data and materials

Abbreviations

Acknowledgements

Author information

Contributions

Corresponding author

Ethics declarations

Consent for publication

Competing interests

Additional information

Rights and permissions

About this article

Share this article

BMC Medicine

Rainstorms impacts on water, sediment, and trace elements loads in an urbanized catchment within Moscow city: case study of summer 2020 and 2021

Cite this article

Access this article

Similar content being viewed by others

The effects of climate variability and land-use change on streamflow and nutrient loadings in the Sesan, Sekong, and Srepok (3S) River Basin of the Lower Mekong Basin

Influence of Diverse Urban Pressures on Water Characteristics in a Small Eastern Mediterranean Watershed

Data availability

Code availability

Author information

Contributions

Corresponding author

Ethics declarations

Conflict of interest

Supplementary Information

Supplementary file1 (PDF 714 KB)

About this article

Share this article