Take each application in turn. For each criteria you have chosen to shortlist against, score the applicant on the extent to which they meet the criteria. You can use any scoring system you wish (0 –3, 0-5) but ensure that it is used consistently across panelists and applicants.