2015 Baldrige Criteria Changes
2015 Baldrige Criteria Changes Updates
The 2015 Criteria have been drafted (see
below) but first,
The 2015 Criteria have been drafted (see below) but first,
But first, congratulations to our customers and newest Baldrige winners:
HealthCare & Hill
But first, congratulations to our customers and newest Baldrige winners: St. David's HealthCare & Hill Country Memorial!!!
Holiday Special: There will be no Christmas for Baldrige Education winner Montgomery County Public Schools this year . . . here's why . . . the School Board has apparently found and widely deployed a balanced and innovative way to dissatisfy students, parents, every religious group, and all other stakeholders.
Baldrige BLOGRIGE appears to have
inadvertently promoted a compelling testimonial for not using the Baldrige
Criteria: The Baldrige Blog appears to have effectively heralded
VHA as a world-class public service role model for health care based on
their use of the Baldrige Criteria and its VA Baldrige Award version (Carey
Award) at the very time VA was 'caught-in-the-act' of pervasively falsifying
patient wait time records and misidentifying hundreds of veterans' graves .
. . really! . . . access this
apparent 'counter-testimonial' Blog link and a summary of this sad state of
Baldrige BLOGRIGE appears to have inadvertently promoted a compelling testimonial for not using the Baldrige Criteria: The Baldrige Blog appears to have effectively heralded VHA as a world-class public service role model for health care based on their use of the Baldrige Criteria and its VA Baldrige Award version (Carey Award) at the very time VA was 'caught-in-the-act' of pervasively falsifying patient wait time records and misidentifying hundreds of veterans' graves . . . really! . . . access this apparent 'counter-testimonial' Blog link and a summary of this sad state of affairs here.
Is Baldrige Still About Excellence?:
US health care is ranked
last among large nations, and it appears that none of the 20
Baldrige HC winners are ranked in the top levels of either the Truven Health
Care Analytics (Top
Hospitals Everest Award) or
US News & Report
HEALTH (Honor Roll Award) top 100 lists for the country ranked
last. . . . so. where is the excellence? And, how does selecting winners
that may be good but are clearly not excellent make US health care
competitive on a global scale? . . . isn't the Mission of the Baldrige Award
to improve American competitiveness? . . . so, how does selecting good but
not excellent hospitals as roll models provide a meaningful reference point
for others that may want to make America more competitive?
Is Baldrige Still About Excellence?: US health care is ranked last among large nations, and it appears that none of the 20 Baldrige HC winners are ranked in the top levels of either the Truven Health Care Analytics (Top Hospitals Everest Award) or US News & Report HEALTH (Honor Roll Award) top 100 lists for the country ranked last. . . . so. where is the excellence? And, how does selecting winners that may be good but are clearly not excellent make US health care competitive on a global scale? . . . isn't the Mission of the Baldrige Award to improve American competitiveness? . . . so, how does selecting good but not excellent hospitals as roll models provide a meaningful reference point for others that may want to make America more competitive?
Baldrige is credited with revolutionizing
American manufacturing? . . . developing . . . check back
Baldrige is credited with revolutionizing American manufacturing? . . . developing . . . check back
there an Ebola link to a Baldrige Site Visit
and Texas Health Presbyterian Dallas? . . . plus a
Baylor Regional Medical Center at Plano
Is there an Ebola link to a Baldrige Site Visit and Texas Health Presbyterian Dallas? . . . plus a Baylor Regional Medical Center at Plano UPDATE
Another Health Care Embarrassment for the
Another Health Care Embarrassment for the Baldrige Award?
Was Texas Health Presbyterian Dallas (the hospital at the center of the Ebola controversy) selected for a site visit at the time that their first of three Ebola patients was there? . . . and did they cancel the Baldrige Site Visit? The Dallas Morning News reported: "Presbyterian loses shot at national award amid Ebola case disputes"
Texas Health Presbyterian Dallas Hospital
Texas Health CEO Statement Excerpts: "I know that, as an institution, we made mistakes in handling this very difficult challenge . . . the fact that Mr. Duncan had travelled to Africa was not communicated effectively among the care team . . . on the visit to the Emergency Department, we did not correctly diagnose his [Thomas Eric Dalton] symptoms as those of Ebola." Barclay Berdan, CEO, Texas Health Resources
Is an Independent Investigation Warranted?
A 'Site-less' and 'Visit-less' Site Visit?: Let's hope not . . . but, The Dallas Morning News article also reports something that if correct may be particularly troublesome for the integrity of the Baldrige Award: "Hospital spokesman Wendell Watson said late Saturday that Baldrige officials had expressed concern about its staff’s safety but considered replicating the visit with telephone interviews." If true, an offer to replicate a site validation visit with telephone interviews is unprecedented, inconsistent, and would have given unfair advantage to Texas Health Presbyterian Dallas. We may never know with certainty if this actually occurred because information related to site visits is appropriately confidential . . . so, maybe the Commerce Department should consider an independent investigation to determine if what was reported is accurate. Hopefully, an offer to do a telephone site visit was incorrectly reported and never occurred but it is important to the image and integrity of the award that the Commerce Department know with certainty what actually occurred and that they inform the public to the extent that is appropriate.
Baldrige and Health Care . . . was the separate health care award category strategy introduced several years after the business-focused award program flawed from the beginning?
Baldrige was established to be a "Business"
Award: So, why is the Commerce Department sponsoring a separate
"health care award" when the Baldrige Award was established by President Reagan
for businesses? In fact, that is precisely why it was located within the
Commerce Department. Why not consider heath care organizations as 'service'
organizations as is done in the leading Asian, European, and Middle East Award
Programs? Or, is there fear that doing this would result in no 'health care
winners'? . . . let's hope not but, if that is indeed true, health care
organizations may benefit by understanding how much they need to improve. More
importantly, it may help to restore the prestige of the Baldrige Award to the
high level it deservedly earned during its early years.
Baldrige was established to be a "Business" Award: So, why is the Commerce Department sponsoring a separate "health care award" when the Baldrige Award was established by President Reagan for businesses? In fact, that is precisely why it was located within the Commerce Department. Why not consider heath care organizations as 'service' organizations as is done in the leading Asian, European, and Middle East Award Programs? Or, is there fear that doing this would result in no 'health care winners'? . . . let's hope not but, if that is indeed true, health care organizations may benefit by understanding how much they need to improve. More importantly, it may help to restore the prestige of the Baldrige Award to the high level it deservedly earned during its early years.
Has the bar for winning the Baldrige Health Care Award been lowered from 'Great' to merely 'Good'?
"Worst-In-Class Health Care?": The US Health Care System is again ranked last among large nations (Source: The Commonwealth Fund, June 16, 2014)
Ominous Quote: "It is, I guess, PC, widely believed, that to say American health care is the best in the world, It's not." Dr. Donald Berwick, former Baldrige Judge and Administrator of the Centers for Medicare and Medicaid Services (CMS)
Good not Great?: There
are no Baldrige Health Care winners
among the Honor Roll (top 17) US HC organizations listed in
US News and World Report
HEALTH (September 2014)
Good not Great?: There are no Baldrige Health Care winners among the Honor Roll (top 17) US HC organizations listed in US News and World Report HEALTH (September 2014)
Bottom Quartile: Texas is rated by as being in the bottom quartile of "The States With the Worst Healthcare Systems" by The Commonwealth Fund (May 1, 2014), and
Not Big in Texas:
News and World Report HEALTH (September 2014) ranks
in Dallas and 20th
in Texas , while Texas Health
Presbyterian Dallas is ranked 5th in Dallas
and 15th in Texas
, while Texas Health Presbyterian Dallas is ranked 5th in Dallas and 15th in Texas
Healthgrades gave Baylor-Plano
its lowest rating for "Patient Safety: "Death in procedures where
mortality is usually low"" (2/27/14)
Patient Safety: Healthgrades gave Baylor-Plano its lowest rating for "Patient Safety: "Death in procedures where mortality is usually low"" (2/27/14)
Award: Baylor-Plano declined accepting the Baldrige Award amidst
publication of patients’ safety allegations related to
patient lawsuits that allege botched surgeries
patient lawsuits that allege botched surgeries ,
Why not require evidence of World-Class Performance as was done in the early years of the award?
Given that at the time of the Baldrige site visit Baylor-Plano management and staff, affected patients, the media, the community, and the local justice system all appear to have been aware of the problems that led Baylor Plano to declining the award, it appears fair to ask:
On what basis
did the US Secretary of Commerce announce them as a
Baldrige winner and cite them as a "role model" of excellence?
did the US Secretary of Commerce announce them as a Baldrige winner and cite them as a "role model" of excellence?
Hopefully, the circumstantial evidence above is not representative of Baylor-Plano overall and that we will learn more about the root cause . . . so far, we have not learned more which leaves the impression that those involved are hoping it will go away with time.
2015 Criteria Developments
The illusion of listening?: The the Baldrige Program's credit, they have reached out more than perhaps ever before. But soliciting input and listening with an open mind are not the same. In fact, the type of improvement feedback solicited was narrowed to only a few topics. History indicates that the Criteria will retain most flaws and introduce new ones.
Why Criteria Terminology Changes are Necessary: In May of 2014, about 50 Baldrige Senior Examiners and Judges participated in a work session to analyze Criteria terminology including 'work systems', 'work processes', 'innovation', 'alignment', and 'integration'. The participants represented more than 500 years of Baldrige experience. Baldrige Program officials facilitated the session in Gaithersburg. All of these terms were unanimously reported as being confusing and/or difficult to understand. So . . ., if the experts find these terms to be difficult to understand, how can the applicants possibly understand them?
Short (?) 2015 Criteria Version:There has been a lot of speculation about a new shorter version of the Criteria for 2015. A draft of the 'Short Criteria' has been developed and it appears that they will consist of nearly 200 separate requirements . . . if this is true, the lack of practicality in the existing Criteria will be preserved in the short version . . . and that is not good.
Vodafone was my 11th telecommunications client in 11 different countries. I am pleased to report that all eleven achieved their project objectives . . . which for most of them was to win their 2013 national quality/excellence award . . . thank you Vodafone for keeping the streak alive . . . and, thank you for the special honor of inviting me to work with a truly outstanding organization that never stops improving.
Has the Baldrige Award Program Gone Out of 'Business'?
For the first time in the 25 year history of the award, there
were no 2013
Baldrige business applicants
and Criteria degradation and impracticality are looking more and more like the primary causes
Source: NIST Baldrige Website
To put this in perspective, not one of the 20 million for-profit businesses in the United States applied for the Baldrige Award this year.
The Baldrige Criteria are regarded by some (myself included) as a valuable tool for organizational and performance excellence assessment.
However, there is a wide gap between their actual value and their perceived value as measured by the 20-year decline in private sector participation show here.
Millions of copies of the Criteria were downloaded but no business organizations applied in 2013. The growing consensus is that Criteria issues are the cause. At a high level, key problems identified by users include:
The Criteria have become exceedingly complex and therefore not practical. This discourages their use. For example, there are 71 separate and distinct questions (requirements) that literally use the word 'engage'. However, there are no questions using the word 'engage' for most types of stakeholders including, suppliers, shareholders, community, or board of directors.
Confusing 'out-of-the-mainstream' terminology is used leading to resistance
The Criteria are imposed for a 2-year period without adequate user review or acceptance
Criteria errors are perpetuated until the next 2-year cycle and sometimes for more than 10 years
The Criteria are overly complex with 985 non-overlapping response requirements including 135 new response requirements for 2013
Major topics including suppliers, customer relationship management, and innovation are cyclically emphasized and de-empathized . . . without any apparent reason
We can all agree or disagree with the reasons for the decline. What is clear is that the Criteria purport to offer a means to improve organizational performance excellence and profit organizations are desperately in need of and open to a means to improve their performance. Defiance of the basic laws of economics: There is an ideal market scenario with both inexhaustible supply and unquenchable demand . . . but, something [arguably the Criteria] has not only prevented growth in the number of 'for profit' applicants but caused a steady exodus.
What follows is a summary of Criteria improvement opportunities (OFIs) identified by users including winners, Examiners, Judges, former Baldrige Foundation Chairman, national award leaders, and an advisor to two US Presidents. Everyone wants to see the Baldrige Program regain its former stature.
Please Note: This summary of the new Criteria changes is being continuously updated. It is possible that in some cases the findings presented may be incorrect. However, if the Criteria are correct and the perception is that they are not, there would appear to be an important opportunity for the Criteria to better communicate to the users.
How many words is too many? There are 5,878 words in the 2013 Criteria and 4,595 additional words in the explanatory notes under the Criteria. Some users think this is too many.
Reinstate 'world-class': As Baldrige celebrates its 25th anniversary, it may want to consider reinstating the original 'world-class' requirement in both processes and results scoring guidelines. America ranks lower internationally in manufacturing, health care (worst among large nations), and education than it did when the Baldrige Program began in 1988. Lowering the competiveness bar for winning to national or regional benchmark levels is not compatible with the award' original purpose and is not the best approach to improving America's competitiveness. Reinstating the original 'world-class' threshold will result in fewer winners but State and international excellence award programs have addressed this effectively by using tiered award levels.
|The Migratory Habits of 'Work
'Work Systems' were relacated from Operations Focus to Strategic Planning for 2013. During the past 20 years, Work Systems have been relocated to the Criteria requirements in 13 Criteria Items, the Organizational Profile, and six of the seven Categories. Work Systems never-ending quest for a permanent home has long confused and frustrated users. Confusion and frustration are not conducive to improvement.
Problematic: In the 2013 Criteria, the design, development, implementation, control, improvement, and sustainability of approximately 95% of the 'key processes' of a large manufacturing organization (e.g., automotive) are not included in the Criteria 'work processes' or 'work systems' requirements because they are performed by suppliers?
'Support Processes' are back after
a 6-year absence and they are now located in the Operations Focus Category
which is problematic for some who view support processes to not be
constrained to being operationally focused. Support processes (AKA, 'support
services') enjoyed their very own
Criteria Item from 1992 through 2004 before
sharing an Item with Operational Planning in 2005 and 2006.They met their Waterloo after
15 years of loyal Criteria service when the 'less than precisely defined' 'Value Creation Processes' were
introduced under the definition that 'Support processes' are not 'value creation'
processes. The protest by support process members who passionately
their processes created value for their organizations was unsuccessful. They
were never to be seen or heard from again . . . until now. Caution: If you
are optimistic that the Criteria learned from the previous issue related to
their not being Value Creation processes then by all means don't read the
notes under the new Item 6.1.
Did you know?: 'Support processes' are not part of 'work processes', 'value creation processes', or 'work systems' . . . if they are performed by members of your workforce?
For 2014, 'support processes' were included as a subset of the 'Operational Focus' Category. Does this mean that all Criteria using organizations now need to have their accounting, sales, marketing, strategy, billing, and human resource organizations reporting to the COO?
Work Process Confusion Acknowledged: In late 2012, the Baldrige Program publically acknowledged after decades of feedback that the term 'work process' was confusing Criteria users. However, it appears that no improvement action has been taken. At the heart of the concern related to 'work processes' is the Criteria definition that work done by members of your organization is part of a 'work process'. If the same work is done by a supplier, it is not part of a 'work process'.
Now You See Them . . . Now You Don't!: Work processes also do not appear to subscribe to Dr. Deming's "Constancy of Purpose" commandment as illustrated below:
1991 - 'work processes' added to Item 4.5
1995 - 'work processes' deleted from the Criteria
1997 - 'work processes' added to Item 5.1
1999 - 'work processes' deleted from the Criteria
2007 - 'work processes' added to Items 3.1, 6.1, 6.2, and 7.5
2009 - 'work processes' deleted from Item 3.1
2011 - 'work processes' added to Item 4.1 and deleted from Item 7.5
2013 - 'work processes' deleted from Item 4.1 and added to Item 7.1
Some users perceive that the relationships between and among 'work process' and 'work system' are convoluted or in some cases invalid. Here is an example: A 'work process' is defined as being performed internally. The same process when performed by a supplier is (as of 2013) included under 'work systems' in Strategy Development. If the same process is performed internally, it is required to be assessed for design, development, implementation, control, improvement, and sustainability. However, these requirements are not part of a Baldrige assessment if a supplier performs the work.
Guide to Knowing What 'Is' or 'Is Not' a 'Work Process': Assembly of Samsung Galaxy smartphones is a 'work process' . . . but, assembly of Apple iPhones is not a 'work process' . . . is there any wonder why the Baldrige Award business applicants dropped to zero in 2013?
'Do or Source' Decision: Sourcing decision-making of 'key processes' (undefined term) is strategic in nature and has appropriately been moved from the downstream 'Operations Focus' Category upstream to the 'Strategic Planning' Category. In addition to processes, organizations do other sourcing including materials, components, and services. In the case of a manufacturing organization, this may represent more than half of their total expenditures. However, it does not appear that the Criteria include how this non-process sourcing is addressed. Selection of suppliers which is different from sourcing decision-making is addressed downstream in 'Operations Focus'. However, supplier selection is often a critical upstream function especially if it relates to innovation or new products, services or programs. For example, new product proposals need to determine if the new product can be reliably and economically made shortly after the Concept Phase.
Business Processes??? Business processes are included in the definitions for both Work Processes and Work Systems . . . but what exactly are business processes? The Criteria do not define what 'business processes' are. Using a term (e.g., business processes) that is defined differently by different people and/or organizations to define Work Systems and Work Processes can only add to the already high level of confusion concerning 'work processes'.
Taking the "Total" out of 'Total Quality': The 'Cost Control' Criteria area has been refocused from 'work systems' to operations in general . . . that is arguably an improvement. But, some may be curious as why the Process Items Criteria do not directly address cost control on a total organizational basis.
Support for Innovation Has Vacillated: The very first Criteria featured innovation as a means to improve organizational competitiveness in the requirements in at least one Item in all Seven Categories of the original Criteria. In fact, it was literally included in the title of each of those Items and Categories. Innovation Dark Ages: During the 1990's, the Criteria deemphasized innovation. For example, the 1993 through 1997 Criteria referenced innovation in only one obscure Sub-Area of one Item (Employee Involvement). For 2013, innovation has been reinstated into at least one Item in every Criteria Category.
The new 'Innovation Management' area in "Operations Focus" is a promising addition . . . except the 2013 Criteria deleted the most important Criteria question from the 2012 Criteria . . .
Criteria Area 2.1a(4) now addresses outsourcing of "processes". This was appropriately relocated from the Operations Focus Category because sourcing decisions are strategic. So, why not address outsourcing of products, components, materials, and/or services? For example, does a hospital outsource the 'process' of making medicines? Does a K-12 school outsource the 'process' of writing textbooks? The bigger issue here is that the Criteria again undervalue the importance of suppliers in this case by minimalizing their critical sourcing value. [Action: If the Criteria really want to provide an example of effectively outsourcing a process, they should consider outsourcing the Process of Criteria Writing . . . just kidding of course.]
SUPPLIERS DENIERS: There Would Not Have Been a Baldrige Award if it Was Not for Suppliers
Baldrige stunned the business community in 2001 by deleting all Supplier-dedicated Criteria Items, Criteria Areas, and Criteria questions.
There would not have been a Baldrige Award if it were not for suppliers: President Reagan was concerned that the Baldrige Award Program could fail if it did not receive wide support from the manufacturing community. He required that financial support for the award be funded 50% by manufacturing suppliers as a condition for his support. For every $300,000 asked from each major manufacturing sponsor organization, it was required that there be an additional $300,000 from their suppliers.
Most Baldrige applicants in the early years were suppliers: The chart at the top of this page paints a bleak trend for manufacturing/supplier applicants . . . from nearly 100 in the early years to only six in 2012.
stunned the business community in 2001
by deleting all Process and
Results Criteria Items, Areas, and Criteria questions dedicated to suppliers.
This led to the December 2001 Quality Digest Magazine cover titled: "Is the
Baldrige Award Still About Quality". The feature story was written by
Richard J. Schonberger a world-acclaimed author and expert in the field of Lean
- Six Sigma and World-Class Manufacturing. He cites several flaws in the
Criteria including the removal of the Items dedicated to suppliers. Dr.
Schonberger's position accurately reflected the sentiment throughout the
business community that sustained the already declining award participation rate
of the business community. Today, a consensus is growing in other sectors
including education and health care that it is important for the Criteria to
the supplier and partner organizations that
represent on the order of 50% of their total expenditures. These costs often
take the form of management, design, HR, maintenance, contract workforce, IT,
customer support, and operational functions.
Good News (sort of): For 2013, Supplier-dedicated Criteria Areas (not Items as before) have returned to the Criteria. This marks a significant first step towards restoring the importance of suppliers in achieving excellence. More pressure needs to be applied to restore the Criteria to their previous supplier recognition level in years 1988 through 2000 but even that will be insufficient.
[Action: Baldrige may want to check out the European Model to gain a better perspective of the importance of suppliers and partners to achieving organizational excellence.]
partners are not second class stakeholders. Give them equal status with other
major stakeholders (e.g., workforce, customers) by adding a dedicated
Suppliers and Partners Focus Category and a corresponding results item. Doing this
will establish applicant accountability to addressing these valuable
stakeholders. The winners’ application summaries (especially healthcare) make a
compelling argument that to win the Baldrige Award it is no longer necessary to
meaningfully address supplier and partner organizations . . . nobody wins
when the value of suppliers is minimalized.
. . nobody wins when the value of suppliers is minimalized.
“On Her Majesty’s Secret
Product” . . . Product? Didn’t you
mean ‘service’ Mr. Bond? No M. The Queen is using the Baldrige Criteria now.
This silly analogy refers to the Criteria requirements references to products and services
being deleted in 2008 (with a few exceptions) and replaced with references to products only. In 2012, I had the opportunity to introduce the Criteria
through assessment training to more than 30 public and private service
organizations in several countries. In every session, I was asked a question by
someone new to the Criteria
equivalent to this: ‘The Criteria do not
apply to us because it asks about how we address products and what our product
results are. We don’t have any products. We are a service organization.’
Disillusioning potential Criteria users and providing ammunition to Criteria
critics within existing users is not a good strategy for gaining acceptance from service organizations.
Strategy Results Have Been Deported Back to their Home Country for 2013: In 2011, 'Strategy Results' ran away from their 'Leadership Results' (Item 7.4) home and illegally entered 'Product Results' (Item 7.1) at a remote border crossing under the cover of darkness. Complaints led to Passport Control eventually locating the adventuresome 'Strategy Results' and unceremoniously deporting them back to their home country of 'Leadership Results'. [Action Consideration: Take away the power to impose the new Criteria without user review and acceptance and these type of changes will be filtered out.]
2012 Criteria Terminology Deleted and Not Included in the 2013 Criteria
'distinctive characteristics of your organizational culture' is deleted from P.1a(2) Vision and Mission
'Education 'levels'' deleted from P.1a(3) Workforce Profile
'Key human resource strategic challenges and advantages' deleted from P.2b Strategic Context
'organizational learning, innovation processes' deleted from P.2c Performance Improvement System
'organizational learning' deleted from 1.1a(3) Creating a Sustainable Organization
'senior leaders' organizational performance expectations' deleted from 1.1b(2) Focus on Action
'Governance System' deleted from 1.2 Overall Item Requirements questions
'How core competencies, strategic challenges and strategic objectives are determined' is deleted from 2.1a(1) Strategic planning Process
'How strategic short- and longer-term planning horizons are set' is deleted from 2.1a(1 Strategy Development Process
'How strategy considers strengths, weaknesses and threats' is deleted from 2.1a(3) Strategy Considerations. In other words, SWOT has been swatted.
'How you identify potential blind spots in your strategic planning process' is deleted from 2.1a(3) Strategy Considerations
'How your strategic objectives address the potential for new core competencies' is deleted from 2.1b(2) Strategic Objective Considerations
'How your strategic objectives balance the short- and longer-term challenges and opportunities' is deleted from 2.1b(2) Strategic Objective Considerations
'How your strategic objectives enhance your ability to adapt to sudden shifts in your market conditions' is deleted from 2.1b(2) Strategic Objective Considerations
'How your strategic objectives address your opportunities for INNOVATION in products, operations, and your business model' is deleted from 2.1b(2) Strategic Objective Considerations. Note: The term 'business model' has been deleted from all areas of the Criteria.
'How do you innovate product offerings to meet the requirements and exceed the expectations of your customer groups and market segments' is deleted from 3.2a(1) Product Offerings
'How do you innovate product offerings to enter new markets, to attract new customers, and to provide opportunities to expand relationships with current customers' is deleted from 3.2a(1) Product Offerings
Design of 'work systems' appears to have been deleted from all areas of the 2013 Criteria.
All five Results Items are now labeled as 'Results' replacing the word 'Outcomes'. All Results Items had been labeled as 'Results' from 1988 through 2005. They were rebranded as 'Outcomes' from 2006 through 2012. No one knows why . . . no one cares . . . except for whoever thought it was a good idea to make the change.
Scoring Points Changes in the 2013 Criteria
Item 2.1 increased 5 points from 40 to 45
Item 2.2 decreased 5 points from 45 to 40
Item 3.1 decreased 5 points from 45 to 40
Item 3.2 increased 5 points from 40 to 45
Item 6.1 increased 5 points from 40 to 45
Item 7.2 decreased 5 points from 90 to 85
Item 7.3 increased 5 points from 80 to 85
Frozen in Time: There have been Criteria Item scoring points changes in every Criteria version since 1988. But, did you know that there have been no changes in the scoring points for the seven Criteria Categories this century?
Additions to the 2013 Criteria
The confusing and well-traveled 'work systems' has been added to area (P.1b(3) of the Organizational Profile. Ironically, it was not added to the 'strategic context' area of P.2. This appears to be diametrically opposed to the 2013 Criteria changes where 'work systems' have been relocated from the Operations Focus Category to the Strategic Planning Category. For those of you keeping score at home, 'work systems was first added to P.1 in 2007, deleted in 2011, and now it is back again . . . or, at least until the next version of the Criteria.
'Key workforce benefits' have been added to P.1a(3).
'Workforce' has been added to P.2b.
'Improvement' of key projects and processes has been added to P.2c. However, improvement of products and services are not included in this performance improvement area. However, 'products' with are included with processes in the Operations Focus Criteria even though they follow the operations in time ["Let's do the time warp again."]
Baldrige has fallen head over heels in love with the trendy term 'intelligent risk' and it is now sprinkled generously throughout the Criteria . . . causing one quality leader of a renowned international organization to quip: "Haven't they heard of FMEAs?" BTW, 'smart risk' finished second in the voting. 'Best guess' finished third. 'Calculated risk', 'risk avoidance', 'minimum risk', and 'risk adverse' withdrew fearing they were not intelligent enough.
'Social media' use shows up in more areas than before.
Call 1 425 444 4386 to discuss the changes, schedule a visit, or set up a video conference to review all the changes with your teams and to lessen the time and resources in transitioning to the new Criteria. Paul Steel
Proposed Baldrige Criteria Improvements Based on User Inputs
2013 Baldrige Criteria Framework Improvement Opportunity
Baldrige Criteria Development Process Improvements
Why all the secrecy? Make the Criteria Improvement Process transparent to the public including the improvement inputs and summaries of the analyses of the inputs. Inform people suggesting improvements of their status including whether they were given to an improvement team, the improvement team's recommendation and the rationale regarding accepting or rejecting suggested improvements.
Require user acceptance of Criteria changes before imposing a two-year freeze (AKA, taking away the authority to impose the Criteria without user approval). Doing this will prevent major mistakes. For example, when the importance of customer relationship management was recently downgraded to a minor role. This error was evident immediately to most users worldwide but no correction was made for years. In addition, the the importance of suppliers partners would never have been allowed to be minimalized. And, portraying projections as results would have been DOA. Errors of this magnitude would never have occurred if Criteria user approval were required.
2013 Baldrige Criteria Improvements
Eliminate the Criteria bloat by reducing the total number of words in the Criteria by more than half to make them more practical for all users especially smaller organizations. One way to reduce the bloat is to use the Singapore Quality Award as a role model. Making the Criteria more practical has been effective in engaging, sustaining engagement, and increasing engagement of the private sector (manufacturing, service and small business) organizations which has not occurred for the Baldrige program as is evident in the summary of applicants charts above. Tweaking and patching the existing Criteria is not the answer. See: Graphic example of Criteria bloat.
Excellent organizations see complexity as waste and as an improvement opportunity. They succeed by reducing complexity . . . not accepting it. Baldrige may be well served to learn from these excellent organizations and advocate simplification. Better yet . . . they could simultaneously strengthen and simplify the Criteria to serve as a role model.
Use a consistent writing style across all areas of the Criteria using the 2012 version of Item 2.1 as a model. It is the most enduring of all Items and it preserves the systems perspective style that previously typified all process Criteria Items. For example, Items 3.1, 3.2, 5.1, and 5.2 have evolved (?) to more of an ISO checklist format (example) which diminishes their systems perspective importance.
Separate the individual Criteria requirements (questions) to improve readability, understanding, and ease of use for assessment, improvement and application submission writing purposes. The bundling of sometimes disparate questions has long had an adverse effect on understanding and ease-of-use. [Update: Unfortunately, the 2013 Criteria failed to take advantage of this improvement opportunity.]
Replace the term "Category" with "System" to better reflect the systems perspective underlying the Criteria and integral to the Baldrige Framework
Category 6 Improvements?
Category 6 has no
"constancy of purpose"
as a famed former mentor
was fond of saying. The terminology has changed
frequently and errantly, the process and systems
questions have been embarrassingly juxtaposed, Item 6.1
and 6.2 had become embarrassingly redundant and
convoluted in the 2009
- 2012 versions. A sense of a shift from a
practical to theoretical is widely perceived and scorn
from business users is pervasive.
Action: Start with a clean sheet and rewrite Category 6 to improve understanding for all users and to provide a basis for reengaging the Business Sector (Service, Manufacturing and Small Business) users and to make it beneficial to all others
Process management is applicable to all processes and systems in Categories 1 through 6. However, the Criteria now exclude all processes except operational processes from being accountable to address process management including design, implementation, cost control, improvement, control/sustainability. So, why not either restore Category 6 to a more global focus or include its questions in the other five Process Categories to ensure consistent deployment.
From 1988 through 2006, the Category 6 equivalent Criteria included designing, improving and controlling most to all processes. Starting in 2007, the focus of process management was narrowed to operations-only processes only. This appears to be counter to the total process focus (e.g., TQC, TQM) that evolved almost fifty years ago. In 2011, the Category was renamed to "Operations Focus" and now appears to exclude all non-operational processes. This creates a gap in how non-operational processes are addressed. For example, Criteria users no longer need to address how they design and innovate non-operational processes (e.g., leadership, strategic planning, workforce engagement, customer engagement, and knowledge management) that are essential to organizational success, it appears that the Criteria are delinquent in addressing process management for these key processes.
Combine Items 6.1 and 6.2 from the 2012 Criteria to eliminate redundancy. For example, why ask applicants to describe the process how they use to design and innovate twice? This implies that there should be a difference in the process used to design systems and processes as opposed to a robust process capable of designing both that is abundantly evident in mature organizations.
Use layman's terminology. Work Processes and Work Systems are not mainstream . . . although, some people within the Baldrige community may have fatigued and succumbed to thinking that they are. For others, these terms limit their acceptance of the Category 6 Criteria. Given that "Work Systems" have now been unsuccessfully trialed in six Categories (no joke) indicates that terminology enamorment may have taken precedence. It may be helpful to know that the Criteria trialed, replaced, and in some cases cycled back to the following types of process nomenclature: production, delivery, business, supplier, partnering, support, service, work, and value creation. This appears to some as a compelling argument that they are practicing a 'trial and error' approach and Criteria users deserve better. Recommendation: Rewrite Category 6 starting with a clean sheet. There is no shortage of people in the Examiner and user community who are capable to assist in doing this.
Move strategic outsourcing to Category 2 (Strategic Planning). The process of deciding which internal processes are best done internally or externally is an upstream strategic decision. It belongs in Strategic Planning (Category 2) and not downstream. [Update: The 2013 Criteria listened to this user feedback.]
Emergency Readiness pertains organization wide. Given that the focus of Category 6 has been narrowed to operations-only, move Emergency Readiness to Leadership or another suitable Category/Item that universally addresses this important area.
Core Terminology Improvements
Baldrige Faux Integration Graphic
|Does Baldrige understand what 'integration' is? Unless some users are really, really wrong, this may be the single-most damaging integrity problem for the award because integration is a core element of both the Criteria and the Scoring Guidelines. The first words of the definition ("integration" refers to the harmonization of . . .") introduced in 2002 are vague and create a sense doubt. When the "Integrated Approaches (70% - 100%)" graphic at the left was added to the Criteria booklet that same year, it appeared to confirm the worst case scenario. This graphic does not depict integration.|
Additional confirmation that alignment is improperly substituted for integration can be found in the 100% scoring band wording for both the Process and Results Scoring Guidelines. Degrading the meaning of integration to alignment greatly lowers the standard of excellence bar and impedes the learning of Criteria users . . . if Baldrige would better define and illustrate integration as well as correct the wording in the Scoring Guidelines, this issue goes away. . . and the effectiveness of the Criteria could be improved as much as a quantum level.
Remove all forms of the word "align" from the Criteria and Scoring Guidelines. Replace them with "integrate/integrate with" as appropriate. When Baldrige uses the term 'integration' in the scoring guidelines (Process and Results) it is actually using 'aligned with' and not 'integrated' [Note: The Scoring Guidelines did not introduce "align" until 1999. See: "Does Baldrige understand what 'integration is?" (see above)]. For this reason, use of 'align' is not necessary and is in fact confusing to many users.
Remove the word "work"
when referring to processes and systems to eliminate the
confusion experienced by many to most users.
Some breaking good news: Baldrige has finally (in September 2012 after 6 years of outcry) admitted that Criteria users are confused by the terms "work processes" and "work systems".
Scoring Points Improvements
Restore the 65 scoring points previously assigned to Product, Process and Strategy Effectiveness performance measures in the 2010 Criteria. This is yet another example where a major Criteria problem could have been prevented if the authority to impose Criteria on users without user acceptance were taken away.
Criteria Engagement Improvements
Restore "services" to the Criteria. Mysteriously, the term "services" has been progressively removed from the Criteria since 2008 causing negative feedback from service, nonprofit, and public sector users worldwide. For example, Item 7.1 was formerly named: "Product and Service Outcomes". This causes confusion in training when and during application submission writing for service-based organizations. Removing 'services' also appears to be counter to the Baldrige Vision: "To be the partner of choice for excellence in every sector of the economy." Ironically, one of the main criticisms of the original 1988 Criteria was that it did not focus on service organizations. The Criteria were quickly modified to address this early concern but now the pendulum appears to have swung back 25 years.
2013 Baldrige Scoring Guidelines Improvements
Reduce the total number of words in the Scoring Guidelines by more than half to make them more practical and effective. For example, is anyone going to read the 400 words in the Results Scoring Guidelines and remember what they read each time they assign a score? . . . not everyone for sure. If the objective is to assess trends, comparisons, segmentation and whether the right results are being presented, there is no need for more than 200 words.
Add a "Segmentation" scoring dimension to the Results Scoring Guidelines to reflect the popularity of this type of feedback comment
Remove all reference to non-results (e.g., projections) from the Results Scoring Guidelines. The outcry when 'projections' were first introduced in Results was unanimous among the many users I encountered including judges . . . yet they still remain at the 100% scoring band.
The terminology "Multiple Requirements", "Overall Requirements" and "Basic Requirements" are confusing to most users and contributes to assessment variation. Guidance that the "requirements" don't really mean "requirements" doesn't help either. Advice to take a holistic view and not hold applicants accountable to the "requirements" . . . well, you get the picture.
Results are quantitative by nature. So, why use judgmental terms (e.g., ‘important’, ‘poor’, ‘good’, ‘good relative’, ‘very good’, ‘good to excellent’, ‘excellent’, or my personal long-time favorite ‘early good’)? They are not needed. They introduce variation into the assessment. Get rid of them.
How is "fully deployed without significant gaps" different from "fully deployed with significant gaps" (BTW, how can something that is fully deployed have significant gaps?) . . . one of several examples where the Scoring Guidelines can be improved through more careful wording selection, simplification, and word count reduction. "Sustained over time" is another.
Improve the coherency of the Results Scoring Guidelines language including the use of 'few’, ‘little’, ‘little to no’, ‘limited’, ‘limited or no’, ‘some’, ‘many’, ‘many to most’, ‘most’, ‘majority’, ‘fully’, or my personal favorite ’mainly’. Examples: Is ‘majority’ closer to ‘many’ or is it closer to ‘most’? Is 'majority' a simple majority? Is 'mainly' more or less than 'majority'? Is 'majority' between 'many' and 'many to most' or between 'many to most' and 'most? How does 'many' relate to 'mainly'? . . . this act needs to be cleaned up folks.
Why does the "accomplishment of Mission" verbiage switch from the Trend scoring dimension to the Integration Scoring dimension in the middle scoring range?
Eliminate confounded terminology. For example, how should the terms “important”, “high priority”, and “key” be used in scoring results? Further, which of them is most important? Which should be given the highest priority? Are they all key terms? This variation in terminology is unnecessary, confusing, and contributes to scoring variation, and reduced assessment validity.
The Results Scoring Guidelines reference customers directly but not other key stakeholders such as workforce, suppliers and partners, and community.
Baldrige Case Study Writing Improvement
Have the Baldrige Case Study writers 'lost the plot'? Warning: The answer is graphic in nature. Viewer discretion is advised.
Baldrige Glossary Improvements
"Imitation is the sincerest form of flattery" . . . but, it is not 'innovation' . . . unfortunately for the Baldrige Glossary
Eliminate the words "Innovation involves the adoption of . . ." from the definition for Innovation to ensure a focus on new and not only copied improvement.
Baldrige Faux Innovation
innovation comes from Latin word ‘nova’ which means new.
The Baldrige definition for innovation is based on the
action verb “adopt” which does not have the same meaning
as new. Adopting something that is not new and defining
it as innovation because it is new to the adopting
organization does not make something that is already
used . . . ‘new’. For example, one Baldrige winner
adopted a process that had been used previously for
more than fifty years and presented this in their
application and in post-award presentations as
innovation . . . not good. However, I suppose that one
could salvage some face-saving value by arguing that at
least this was an innovative application of an old
process. But, that is not simply not good enough for a
role model winner. The point is that the
organization should not be faulted . . . rather, the Baldrige
definition is the enabler of this degradation of the
meaning of the term 'innovation'..
Further, it appears that Baldrige may have
mistaken a classic corrective action process for
innovation in the Criteria Booklet graphic to
Further, it appears that Baldrige may have mistaken a classic corrective action process for innovation in the Criteria Booklet graphic to the left.
Most importantly, allowing imitation to be credited as innovation adversely affects the competitiveness improvement rate of organizations using the Criteria.
2012 Baldrige Criteria
Download special MS Word versions of the Baldrige Criteria at the B21 Home Page
Baldrige Criteria for Performance Excellence versions with and without changes highlighted
See the hundreds of the multiple Criteria requirements that have been deleted from the previous version
Baldrige Criteria Navigator
Click on the Criteria Navigator below to see all the new additions and deletions - here and only here
Preface: Organizational Profile
Category and Items
Measurement, Analysis, and Knowledge Management
2012 Baldrige Health Care Criteria Navigator
2012 Baldrige Education Criteria Navigator
Thank you for using and hopefully sharing the only truly integrated versions of the Baldrige Criteria. Paul Steel
2012 BALDRIGE SCORING GUIDELINES - with changes highlighted
Baldrige improvement accelerated and made practical with tools and resources from the most experienced source
|25th Baldrige Anniversary Special||Scoring Guidelines|
Questions or feedback: Email: PaulSteel@Outlook.com
Accelerating organizational improvement beyond
the capabilities of all Business Excellence
MISSION: Accelerating organizational improvement beyond the capabilities of all Business Excellence approaches combined. Paul
Special limited time offers:
Did you ever wonder how the 1988 Original Malcolm Baldrige Criteria compares to the current version?
MISSION: Accelerating organizational improvement beyond the capabilities of Business Excellence approaches. Paul Steel
Classic 'Quality Gurus Summit' photo (Click on photo for larger version)
All information provided here on the www.Baldrige21.com website are not intended in any way to represent the views of the Baldrige Performance Excellence Program @ http://www.nist.gov/baldrige