WIP: Resolve "Horizontal CI lanes for each app"

Closed Varac requested to merge 633-horizontal-ci-lanes-for-each-app into master