Chris Yang
06/15/2023, 12:58 AMRalf Huuck
06/15/2023, 6:29 AMRalf Huuck
06/15/2023, 6:30 AMRalf Huuck
06/15/2023, 6:38 AMChris Yang
06/15/2023, 9:53 AMOlivier Kouame
06/16/2023, 1:08 PMOlivier Kouame
06/16/2023, 1:10 PMFang Yuan
06/16/2023, 2:17 PMIn a randomized trial on 147 repositories in use at Microsoft, Nudge was able to reduce pull request resolution time by 60% for 8,500 pull requests, when compared to overdue pull requests for which Nudge did not send a notification. Furthermore, developers receiving Nudge notifications resolved 73% of these notifications as positive. We observed similar results when scaling up the deployment of Nudge to 8,000 repositories at Microsoft, for which Nudge sent 210,000 notifications during a full year.2. Meta
Weāve found a correlation between slow diff review times (P75) and engineer dissatisfaction. Our tools to surface diffs to the right reviewers at key moments in the code review lifecycle have significantly improved the diff review experience.3. LinkedIn - Dev Prod Engineering - measures happiness and productivity @Olivier Kouame
Here are some of the metrics we decided to adopt:
⢠Developer Build Time (P50 and P90) - measures the time, in seconds, developers spend waiting for their builds to finish locally during development.
⢠Code Reviewer Response Time (P50 and P90) - measures how long it takes, in business hours, for code reviewers to respond to each update of the code review from the author.
⢠Post-Commit CI Speed (P50 and P90) - measures how long it takes, in minutes, for each commit to get through the continuous integration (CI) pipeline.
⢠CI Determinism - the opposite of test flakinessāthe chance that a test suiteās result will be valid (not a flake)
⢠Deployment Success Rate - measures how often deployments succeed.
⢠Net User Satisfaction (NSAT) - measures, on a quarterly basis, how happy developers are overall with our development systems.
Abi Noda
06/21/2023, 7:39 PMAbi Noda
06/21/2023, 7:39 PMChris Yang
11/30/2023, 2:08 AM