Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Short description: The paper includes the challenges and the proposed solutions for engineering machine learning (ML) systems from a software engineering (SE) perspective. The source of this analysis is 141 papers published in SE venues.
Why is it relevant? The paper is on SE aspects of engineering ML systems.
What is the lesson learned from reading the article? All challenges categorized and listed under SE subareas, i.e., requirements engineering, design, etc. The non-deterministic nature of ML systems complicates all SE aspects of engineering ML systems. Despite increasing interest from 2018 onwards, the results reveal that none of the SE aspects have a mature set of tools and techniques. Testing is by far the most popular area among researchers. Even for testing ML systems, engineers have only some tool prototypes and solution proposals with weak experimental proof. Many of the challenges of ML systems engineering were identified through surveys and interviews. Researchers should conduct experiments and case studies, ideally in industrial environments, to further understand these challenges and propose solutions.
How does it add new insights over the articles already listed? It involves a high-level and broad SE view for engineering ML systems.
P.S.: I added the paper at the top of the list since you want to have the lists in an alphabetical order. Please feel free to change its order if you accept the paper to include in the list.