Workflow

Historical development

The development of the concept of a workflow occurred above a series of loosely defined, overlapping eras.

Beginnings in manufacturing

The modern history of workflows can be traced to Frederick Taylor and Henry Gantt, although the term "workflow" was not in use as such during their lifetimes. One of the earliest instances of the term "work flow" was in a railway engineering journal from 1921.

Taylor and Gantt launched the study of the deliberate, rational organization of work, primarily in the context of manufacturing. This gave rise to time and motion studies. Related concepts include job shops and queuing systems (Markov chains).

The 1948 book Cheaper by the Dozen introduced the emerging concepts to the context of family life.

Maturation and growth

The invention of the typewriter and the copier helped spread the study of the rational organization of labor from the manufacturing shop floor to the office. Filing systems and other sophisticated systems for managing physical information flows evolved. Several events likely contributed to the development of formalized information workflows. First, the field of optimization theory matured and developed mathematical optimization techniques. For example, Soviet mathematician and economist Leonid Kantorovich developed the seeds of linear programming in 1939 through efforts to solve a plywood manufacturer's production optimization issues. Second, World War II and the Apollo program drove process improvement forward with their demands for the rational organization of work.

Quality era

In the post-war era, the work of W. Edwards Deming and Joseph M. Juran led to a focus on quality, first in Japanese companies, and more globally from the 1980s: there were various movements ranging from total quality management to Six Sigma, and then more qualitative notions of business process re-engineering. This led to more efforts to improve workflows, in knowledge economy sectors as well as in manufacturing. Variable demands on workflows were recognised when the theory of critical paths and moving bottlenecks was considered.

Workflow management

Basu and Kumar note that the term "workflow management" has been used to refer to tasks associated with the flow of information through the value chain rather than the flow of material goods: they characterise the definition, analysis and management of information as "workflow management". They note that workflow can be managed within a single organisation, where distinct roles are allocated to individual resources, and also across multiple organisations or distributed locations, where attention needs to be paid to the interactions between activities which are located at the organizational or locational boundaries. The transmission of information from one organization to another is a critical issue in this inter-organizational context and raises the importance of tasks they describe as "validation", "verification" and "data usage analysis".

Workflow management systems

Main article: Workflow management system

A workflow management system (WfMS) is a software system for setting up, performing, and monitoring a defined sequence of processes and tasks, with the broad goals of increasing productivity, reducing costs, becoming more agile, and improving information exchange within an organization. These systems may be process-centric or data-centric, and they may represent the workflow as graphical maps. A workflow management system may also include an extensible interface so that external software applications can be integrated and provide support for wide area workflows that provide faster response times and improved productivity.

Related concepts

The concept of workflow is closely related to several fields in operations research and other areas that study the nature of work, either quantitatively or qualitatively, such as artificial intelligence (in particular, the sub-discipline of AI planning) and ethnography. The term "workflow" is more commonly used in particular industries, such as in printing or professional domains such as clinical laboratories, where it may have particular specialized meanings.

1. Processes: A process is a more general notion than workflow and can apply to, for example, physical or biological processes, whereas a workflow is typically a process or collection of processes described in the context of work, such as all processes occurring in a machine shop.
2. Planning and scheduling: A plan is a description of the logically necessary, partially ordered set of activities required to accomplish a specific goal given certain starting conditions. A plan, when augmented with a schedule and resource allocation calculations, completely defines a particular instance of systematic processing in pursuit of a goal. A workflow may be viewed as an often optimal or near-optimal realization of the mechanisms required to execute the same plan repeatedly.
3. Flow control: This is a control concept applied to workflows, to distinguish from static control of buffers of material or orders, to mean a more dynamic control of flow speed and flow volumes in motion and in process. Such orientation to dynamic aspects is the basic foundation to prepare for more advanced job shop controls, such as just-in-time or just-in-sequence.
4. In-transit visibility: This monitoring concept applies to transported material as well as to work in process or work in progress, i.e., workflows.

Examples

The following examples illustrate the variety of workflows seen in various contexts:

1. In machine shops, particularly job shops and flow shops, the flow of a part through the various processing stations is a workflow.
2. Insurance claims processing is an example of an information-intensive, document-driven workflow.
3. Wikipedia editing can be modeled as a stochastic workflow.
4. The Getting Things Done system is a model of personal workflow management for information workers.
5. In software development, support and other industries, the concept of follow-the-sun describes a process of passing unfinished work across time zones.
6. In traditional offset and digital printing, the concept of workflow represents the process, people, and usually software technology (RIPs raster image processors or DFE digital front end) controllers that play a part in pre/post processing of print-related files, e.g., PDF pre-flight checking to make certain that fonts are embedded or that the imaging output to plate or digital press will be able to render the document intent properly for the image-output capabilities of the press that will print the final image.
7. In scientific experiments, the overall process (tasks and data flow) can be described as a directed acyclic graph (DAG). This DAG is referred to as a workflow, e.g., Brain Imaging workflows.
8. In healthcare data analysis, a workflow can be identified or used to represent a sequence of steps which compose a complex data analysis.
9. In service-oriented architectures, an application can be represented through an executable workflow, where different, possibly geographically distributed, service components interact to provide the corresponding functionality under the control of a workflow management system.
10. In shared services, an application can be in the practice of developing robotic process automation (called RPA or RPAAI for self-guided RPA 2.0 based on artificial intelligence) which results in the deployment of attended or unattended software agents to an organization's environment. These software agents, or robots, are deployed to perform pre-defined structured and repetitive sets of business tasks or processes. Artificial intelligence software robots are deployed to handle unstructured data sets and are deployed after performing and deploying robotic process automation.

Features and phenomenology

1. Modeling: Workflow problems can be modeled and analyzed using graph-based formalisms like Petri nets.
2. Measurement: Many of the concepts used to measure scheduling systems in operations research are useful for measuring general workflows. These include throughput, processing time, and other regular metrics.
3. Specialized connotations: The term "workflow" has specialized connotations in information technology, document management, and imaging. Since 1993, one trade consortium specifically focused on workflow management and the interoperability of workflow management systems, the Workflow Management Coalition.
4. Scientific workflow systems: These found wide acceptance in the fields of bioinformatics and cheminformatics in the early 2000s, when they met the need for multiple interconnected tools that handle multiple data formats and large data quantities. Also, the paradigm of scientific workflows resembles the well-established practice of Perl programming in life science research organizations, making this adoption a natural step towards more structured infrastructure setup.
5. Human-machine interaction: Several conceptualizations of mixed-initiative workflows have been studied, particularly in the military, where automated agents play roles just as humans do. For innovative, adaptive, and collaborative human work, the techniques of human interaction management are required.
6. Workflow analysis: Workflow systems allow users to develop executable processes with no familiarity with formal programming concepts. Automated workflow analysis techniques can help users analyze the properties of user workflows to conduct verification of certain properties before executing them, e.g., analyzing flow control or data flow. Examples of tools based on formal analysis frameworks have been developed and used for the analysis of scientific workflows and can be extended to the analysis of other types of workflows.

Workflow improvement theories

Several workflow improvement theories have been proposed and implemented in the modern workplace. These include:

1. Six Sigma
2. Total Quality Management
3. Business Process Reengineering
4. Lean systems
5. Theory of Constraints

Evaluation of resources, both physical and human, is essential to evaluate hand-off points and potential to create smoother transitions between tasks.

Components

A workflow can usually be described using formal or informal flow diagramming techniques, showing directed flows between processing steps. Single processing steps or components of a workflow can basically be defined by three parameters:

1. input description: the information, material and energy required to complete the step
2. transformation rules: algorithms which may be carried out by people or machines, or both
3. output description: the information, material, and energy produced by the step and provided as input to downstream steps

Components can only be plugged together if the output of one previous (set of) component(s) is equal to the mandatory input requirements of the following component(s). Thus, the essential description of a component actually comprises only input and output that are described fully in terms of data types and their meaning (semantics). The algorithms' or rules' descriptions need only be included when there are several alternative ways to transform one type of input into one type of output – possibly with different accuracy, speed, etc.

When the components are non-local services that are invoked remotely via a computer network, such as Web services, additional descriptors (such as QoS and availability) also must be considered.

Applications

Main article: Workflow application

A workflow application is a software application that automates, to at least some degree, a process or processes. The processes are usually business-related but can be any process that requires a series of steps to be automated via software. Some steps of the process may require human intervention, such as approval or the development of custom text, but functions that can be automated should be handled by the application. Advanced applications allow users to introduce new components into the operation.

References

References

1. (27 October 2009). "Business Process Management Center of Excellence Glossary".
2. See e.g., ISO 12052:2006, [http://www.iso.org ISO.org]
3. See e.g., ISO/TR 16044:2004, [http://www.iso.org ISO.org]
4. "Work Flow Automation".
5. Taylor, 1919
6. [https://books.google.com/ngrams/graph?content=workflow%2Cwork+flow%2C+work-flow&year_start=1800&year_end=2000&corpus=15&smoothing=3&share=&direct_url=t1%3B%2Cworkflow%3B%2Cc0%3B.t1%3B%2Cwork%20flow%3B%2Cc0%3B.t1%3B%2Cwork%20-%20flow%3B%2Cc0 Ngram Viewer ]
7. (1921). "The Railway Engineer".
8. (5 February 2014). "The History of Accounting (RLE Accounting): An International Encyclopedia". Routledge.
9. Michael L. Pinedo. (7 January 2012). "Scheduling: Theory, Algorithms, and Systems". Springer.
10. [https://books.google.com/ngrams/graph?content=job+shops%2Cflow+shops%2Cqueuing+systems&year_start=1800&year_end=2000&corpus=15&smoothing=3&share=&direct_url=t1%3B%2Cjob%20shops%3B%2Cc0%3B.t1%3B%2Cflow%20shops%3B%2Cc0%3B.t1%3B%2Cqueuing%20systems%3B%2Cc0 Ngram Viewer]
11. Katseneliboigen, A.. (1990). "The Soviet Union: Empire, Nation, and System". Transaction Publishers.
12. Choudhury, K.. (2002). "Frontiers of Economics: Nobel Laureates of the Twentieth Century". Greenwood Press.
13. Smith, J.L.. (July 2009). "The History of Modern Quality". Central Illinois Business Publishers, Inc.
14. Shrader, C.R.. (2009). "History of Operations Research in the United States Army: Volume III, 1973–1995". United States Army.
15. Robins Jr., C.H.. (2007). "Program and Project Management Improvement Initiatives". ASK Magazine.
16. (13 October 2009). "Reengineering the Corporation: Manifesto for Business Revolution, A". HarperCollins.
17. Goldratt, Eliyahu M.[https://www.toc-goldratt.com/content/My-Saga-to-Improve-Production "My saga to improve production." MANAGEMENT TODAY-LONDON- (1996).]
18. Basu, A. and Kumar, A., [https://www.jstor.org/stable/23015820 Research Commentary: Workflow Management Issues in e-Business], ''Information Systems Research'', volume 13, no. 1, March 2002, pp. 1-14, accessed 1 December 2022
19. (2012). "Workflow Management Systems and Interoperability". Springer Science & Business Media.
20. Artem M. Chirkin, Sergey V. Kovalchuk. (2014). "Towards Better Workflow Execution Time Estimation". IERI Procedia.
21. Havey, M.. (2005). "Essential Business Process Modeling". O'Reilly Media, Inc.
22. [http://ftp.hp.com/pub/services/hardware/info/hw_globalsupportctr_59829873EN.pdf Follow-the-sun process]
23. Brain Image Registration Analysis Workflow for fMRI Studies on Global Grids, [http://www2.computer.org/portal/web/csdl/doi/10.1109/AINA.2009.13 Computer.org]
24. A grid workflow environment for brain imaging analysis on distributed systems, [http://doi.wiley.com/10.1002/cpe.1461 Wiley.com]
25. (23 August 2019). "Advantages and challenges of using mobile ethnography in a hospital case study: WhatsApp as a method to identify perceptions and practices". Qualitative Research in Medicine and Healthcare.
26. (2011). "Implementation of workflow engine technology to deliver basic clinical decision support functionality". BMC Medical Research Methodology.
27. Service-Oriented Architecture and Business Process Choreography in an Order Management Scenario: Rationale, Concepts, Lessons Learned, [http://doi.acm.org/10.1145/1094855.1094965 ACM.org]
28. "Introduction to the Workflow Management Coalition". Workflow Management Coalition.
29. (2010). "The design and implementation of a workflow analysis tool". Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.
30. Alvord, Brice. (2013). "Creating A Performance Based Culture In Your Workplace". Lulu.com.
31. D. Kyriazis. (June 2008). "An innovative workflow mapping mechanism for Grids in the frame of Quality of Service". Future Generation Computer Systems.
32. (2002). "Workflow Handbook 2002". Future Strategies.