How Large Youth Sports Associations Run Fair Tryouts
Large youth sports associations run fair tryouts by doing five things well: they use the same criteria, scoring scale, and ranking weights at every location, have multiple independent evaluators score every athlete, check scores for bias and errors before making decisions, document how every team was formed, and send every athlete feedback that shows how they placed. The bigger the tryout, the more each of these matters.
Transparency and fairness tie it all together. In SkillShark’s 2025 customer survey, 96% of organizations said SkillShark made their evaluations fairer and more objective.
SkillShark is a tryout and athlete evaluation app used by more than 1,200 organizations across 30+ sports, including Volleyball Canada and USSSA Fastpitch. Here’s what we’ve learned from more than 85 million scores and 3.2 million athletes evaluated.
Why is fairness harder at large tryouts?
A club tryout with 40 athletes and three coaches is manageable. An association tryout with 800 athletes, 12 age groups, three locations, and 40 volunteer evaluators is a different job.
At that size, problems multiply quickly:
Evaluators score differently. One evaluator’s 4 is another’s 2.
Athletes in the late session get scored by tired evaluators.
Parent-coaches end up scoring their own kids.
Scores get lost, entered twice, or typed wrong when they move from paper to spreadsheets.
When a family asks “Why didn’t my kid make AA?”, nobody can show them the data, and the conversation gets awkward fast.
Every one of these is fixable with a standardized process, built for scale and set up before tryouts start.
What criteria should an association publish before tryouts?
Publish the skills you’ll evaluate and what each score means, and share them with families before tryout day. A 1–5 skating score is only fair if every evaluator knows what separates a 3 from a 4.
Keep it focused. Five to eight criteria per age group is plenty. More than that and evaluators start guessing.
In SkillShark, each skill can include instructions and pre-filled comments, so evaluators see the same definitions on their phone, tablet, or laptop while they score. For example:
1 = Needs significant improvement
2 = Developing, below age-group level
3 = Meets age-group level
4 = Above age-group level
5 = Exceptional for age group
How do associations keep scoring consistent across locations?
Use one evaluation template, one scoring scale, and one set of ranking weights everywhere. If the north rink weights skating at 30% and the south rink weights it at 20%, the rankings can’t be compared, and families will notice.
Consistency means:
The same skills, criteria, and score definitions.
The same ranking weights across every location.
All scores in one place, so athletes from different locations can be ranked side by side.
In SkillShark, you can use the same evaluation template and ranking criteria across every location and group, so athletes are evaluated the same way no matter where they try out.
Should tryouts use objective or subjective scores?
Both. Objective scores are measured results like sprint times, pitching velocity, or free-throw makes. Subjective scores are evaluator ratings for things a stopwatch can’t measure, like attitude, mechanics, or athleticism.
Objective scores matter because they’re the same no matter who’s watching. A 7.2-second sprint is a 7.2-second sprint. They’re hard to argue with, they’re immune to evaluator bias, and they give families something concrete when you explain a decision.
But objective scores alone miss the player who reads the game two steps ahead. The fairest tryouts use measured results to anchor the evaluation and independent ratings to capture the rest.
SkillShark has a built-in stopwatch, lets evaluators record multiple attempts, and lets you enter results from laser timing or other tools. On All-Star and Legend, Pocket Radar velocity readings sync straight into each player’s evaluation.
How many evaluators should score each athlete?
At least two independent evaluators per athlete, and three if you can. One evaluator’s opinion becomes a much smaller part of the final result when it’s averaged with others.
Evaluators shouldn’t score athletes they coach, and parents shouldn’t score their own kids. Many associations bring in outside evaluators to reduce bias. Separate the jobs, too: have coaches run the drill stations so evaluators can focus on scoring.
How do you keep digital scoring secure?
Make sure only the people you invite can score, and that every score is tied to a verified person. Some digital tools let evaluators join with a shared access code and no password. Anyone with the code can score players, and there’s no way to verify who’s behind each score. That leaves room for unauthorized scoring or someone scoring as another evaluator.
Every SkillShark evaluator is invited individually and gets their own password-protected account, so every score has a verified name attached. Permissions on every plan control who can edit scores or manage the evaluation template. For association-wide oversight, the Legend plan adds fully custom roles. You choose which teams and players each staff member can see, and what they can do across the account, from reports to messaging, so directors can oversee every location while coaches focus on their own groups.
How do you handle evaluators who score too high or too low?
Every large tryout has a generous scorer and a tough one. If athlete rankings depend on which evaluator happened to watch them, the process isn’t fair.
There are two fixes:
Calibrate before tryouts. Walk evaluators through your rating scale and what each number means. Then have them score a few warm-up reps together and compare. It takes 15 minutes and catches the biggest gaps.
Adjust for scoring differences after. SkillShark can normalize scores to account for overly harsh or generous evaluators. Original scores never change, and you can view raw, averaged, or normalized results anytime.
How do you catch scoring mistakes before making decisions?
Review all the tryout data before team selections. SkillShark’s Score Audit tool flags unusually high or low scores, missing scores, and likely typos, like 500 instead of 50.
This step gets skipped most often when an association is rushing to post teams. In SkillShark, it’s easy to run Score Audit after tryouts. Choose strict, standard, or relaxed sensitivity, and it highlights every unusual score. Then it walks you through each one, so you can dismiss it, fix an error, or check with the evaluator before selecting teams.
How do associations turn scores into fair teams?
Associations turn scores into fair teams by scoring every athlete on the same criteria, using team formation tools to build balanced or tiered teams, and then applying their own selection rules.
In SkillShark, you can use:
Weighted rankings: decide how much each skill counts toward overall rankings.
Position-specific rankings: set different ranking criteria by position, so you compare goalies with goalies and pitchers with pitchers.
Weighting by session (All-Star and Legend): count scrimmages more than skills sessions, or vice versa.
Balanced or ranked drafts: split athletes into evenly matched teams or top-down ranked teams, including across multi-round, multi-day tryouts.
Tiered teams (All-Star and Legend): place athletes into tiers like AA, A, and B based on your rankings.
Every association has its own selection rules. Some must select the top-ranked athletes and leave room for a set number of coach’s picks. Others keep siblings or twins on the same team. Rankings give you a fair, consistent starting point, and your association always gets the final say.
How do you explain decisions to families?
Families accept tough decisions more readily when they can see how the decisions were made. Send every athlete specific feedback, not just a yes or no.
With SkillShark, you can email polished report cards with each athlete’s scores and evaluator comments. Customize them with your logo, colors, and banner image. On All-Star and Legend, you can also email team placements to every family at once from the Message Center.
After switching to SkillShark’s digital evaluations, Aurora Soccer reported about 80% fewer complaints.
What does a fair large-association tryout look like?
A fair large-association tryout follows the same plan before, during, and after tryout day, so every athlete is judged the same way no matter which location or session they attend.
Before tryouts
Publish your criteria and scoring definitions, and share them with families.
Use the same evaluation template and ranking weights at every location.
Recruit independent evaluators, invite each one to their own secure account, and assign them to age groups their kids aren’t in.
Import athletes from your registration platform.
Run a short calibration session so every evaluator knows what each score means.
During tryouts
Have coaches run drill stations so evaluators can focus on scoring.
Have multiple evaluators score every athlete, even offline at rinks and fields with no Wi-Fi.
Build balanced or ranked scrimmage groups, and regroup between rounds for multi-day tryouts.
Record objective results like sprint times and velocity alongside subjective evaluator ratings.
Add walk-ons on the spot with full profiles.
After tryouts
Audit scores before making team decisions.
Rank athletes using your skill weights and positions.
Form teams, and send your roster list back to TeamSnap, SportsEngine, or TeamLinkt.
Keep every score and evaluator comment so you can explain any decision.
Share feedback with families with professional branded report cards.
Use the same template and process next season, so you can view each athlete’s progress year over year.
Frequently Asked Questions
Can SkillShark handle tryouts with thousands of athletes?
Yes. SkillShark is built for multi-location, multi-age-group tryouts with many evaluators scoring at once. Going Yard Baseball evaluated 1,200 players and saved 120 hours of admin work.
How do you keep tryout scoring consistent across multiple locations?
Use the same evaluation template, scoring scale, and ranking weights at every location, and keep all scores in one system so athletes can be ranked side by side.
Should parent-coaches evaluate at tryouts?
Ideally, no. Evaluators shouldn’t score their own child or athletes they coach. If you need volunteer evaluators, assign them to age groups their kids aren’t in.
What scoring scale works best?
A 1–5 scale with a written definition for each number is the easiest for volunteers to use consistently.
Does SkillShark work with our registration platform?
Yes. Import athletes from TeamSnap, SportsEngine, TeamLinkt, or LeagueApps, and send your roster list back to TeamSnap, SportsEngine, or TeamLinkt.
How much does SkillShark cost for a large association?
Large organizations get volume pricing. Contact us for a quote. Standard pricing is $5–$15 per athlete per year, and you only use a license when an athlete is scored.