TIL - Xcode can display build time right there in the activity view:

defaults write com.apple.dt.Xcode ShowBuildOperationDuration YES

Command line preference settings. Living in the future.