Friday, December 28, 2007

Using Test Protocols for Evaluation of Players



One of the things that has always fascinated me about baseball, and sports in general, is how players get better. What is it about the superstars that elevates them above the average players? What are the physical attributes, the mental and emotional requirements? In baseball, what are the visual skills that are necessary for success at the highest levels? When I was a player, the emphasis was on using this information to become a better player. When I became a coach, the emphasis changed to learning and developing the most effective methods to allow upcoming players to succeed.

Along the way, I saw examples in football, beginning with Gil Brandt of the Dallas Cowboys, using test protocols to more effectively identify talented college players for his team to draft. It was fascinating to see him use these physical tests, as well as mental and emotional tests, like the Wonderlich test, to identify the players with the highest chances of success, more efficiently than his competitors.

It seemed like a no-brainer intuitively, but in most sports, the coaches and administrators still use hunches and intuition and gut instinct to make these important personnel decisions. There was a great reluctance to use modern tools and knowledge from other fields to aid in the decisions. Baseball men feel that what was done 50-100 years ago to judge and draft players works just fine, thank you very much.

My gut instincts and intuition have always led me to believe that the things that have worked in other sports to improve scouting, talent identification and player development would also work in baseball.

The player draft in all sports that have one is a prime determinant of which teams will be successful in the future and which ones will fail, so the stakes are high. In spite of drafting lower than most of his competitors, a result f the Cowboys success, Brandt’s scouting department consistently identified and drafted better players in the later rounds of the drafts than some teams did in the first and second rounds. Clearly, he was doing things better and more efficiently than other teams in terms of scouting and talent identification.

As front office and scouting personnel left the Cowboys for other team’s years later, the rest of the NFL learned that Brandt was a proponent of using certain physical tests and measurements to compare players at similar positions. For lineman, he wanted large strong men, the larger and stronger the better. So rather than simply compare how well a player performed he would find out how many times the players he was interested in could bench press 225 lbs, for positions where speed was a large component of success or failure, he measured them in the 40 yard dash and so on. He felt that simply judging collegiate players by how they performed in a limited number of games, many times against inferior competition, was inefficient. Most of these test and procedures he developed have since shown to be effective at a statistically significant level. There is a strong correlation between the ranking of players in the battery of tests and future success in the NFL.

The crux of Brandt’s theory is if you give your coaches the players with the best athletic skill sets to succeed, then it’s the coaching staff’s job to teach them the specific sports skills to succeed at that level. That’s what coaches are paid to do.

Most sports teams are copycats, when one team is successful using a certain method or procedure, others begin to copy in droves in hope that the success would follow. The cost of failure in drafting unproductive and players in sorts is too high both economically, in terms of the amount of bonuses paid to high draft picks. Today, almost every team in the NFL participates in the NFL combine, however baseball has stuck with its tradition based scouting methods.

It’s my opinion and that of other coaches and trainers that I work with that the time has come for baseball to start using this type of approach to evaluate the players it chooses. Many top draft picks receive million dollar plus bonuses. With that financial windfall and the notoriety of being a high draft pick, comes a lot pressure. Many players who have the requisite physical skills wash out because they are not mentally tough enough to handle failure. Some don’t have a strong enough work ethic and succeeded at lower levels on the basis of their superior physical gifts. There are tests that other sports have used to identify these traits in athletes.

Once you have the battery of tests that correctly identify the physical, mental and emotional qualities you need in an athlete, you should be able to use that tool to more efficiently identify which players would make your team in a tryout setting or which players to draft in the professional setting. In both cases, the problem facing teams and coaches is there are simply too many players to evaluate in a limited amount of time. The inefficiency is that the scouting department is using poorly defined or subjective parameters to identify talent. In baseball, many scouts still used the old hand-me-down term “he has the good face” to describe a prospect they like and they believe has a high probability for future success. The problem being fifty different scouts are likely to give you fifty different opinions as to what the term means. It’s too subjective and vague. The tests bring a level of accuracy and precision that baseball has never had before.

Scouts and baseball men are very guarded about their traditions and procedures. It’s safer for them to fail “going by the book” than to fail doing something outside the box. That gets you fired. It will take an organization with guts to change the culture in their scouting and player development department to make the change. Or maybe we simply need a man with the courage and conviction of Gil Brandt. So far, I have used the same methodology at every level through high school baseball with excellent results. I would like to see it eventually make its way to the professional level. It would be simply revolutionary.

No comments:

Giants Top Minor League Prospects

  • 1. Joey Bart 6-2, 215 C Power arm and a power bat, playing a premium defensive position. Good catch and throw skills.
  • 2. Heliot Ramos 6-2, 185 OF Potential high-ceiling player the Giants have been looking for. Great bat speed, early returns were impressive.
  • 3. Chris Shaw 6-3. 230 1B Lefty power bat, limited defensively to 1B, Matt Adams comp?
  • 4. Tyler Beede 6-4, 215 RHP from Vanderbilt projects as top of the rotation starter when he works out his command/control issues. When he misses, he misses by a bunch.
  • 5. Stephen Duggar 6-1, 170 CF Another toolsy, under-achieving OF in the Gary Brown mold, hoping for better results.
  • 6. Sandro Fabian 6-0, 180 OF Dominican signee from 2014, shows some pop in his bat. Below average arm and lack of speed should push him towards LF.
  • 7. Aramis Garcia 6-2, 220 C from Florida INTL projects as a good bat behind the dish with enough defensive skill to play there long-term
  • 8. Heath Quinn 6-2, 190 OF Strong hitter, makes contact with improving approach at the plate. Returns from hamate bone injury.
  • 9. Garrett Williams 6-1, 205 LHP Former Oklahoma standout, Giants prototype, low-ceiling, high-floor prospect.
  • 10. Shaun Anderson 6-4, 225 RHP Large frame, 3.36 K/BB rate. Can start or relieve
  • 11. Jacob Gonzalez 6-3, 190 3B Good pedigree, impressive bat for HS prospect.
  • 12. Seth Corry 6-2 195 LHP Highly regard HS pick. Was mentioned as possible chip in high profile trades.
  • 13. C.J. Hinojosa 5-10, 175 SS Scrappy IF prospect in the mold of Kelby Tomlinson, just gets it done.
  • 14. Garett Cave 6-4, 200 RHP He misses a lot of bats and at times, the plate. 13 K/9 an 5 B/9. Wild thing.

2019 MLB Draft - Top HS Draft Prospects

  • 1. Bobby Witt, Jr. 6-1,185 SS Colleyville Heritage HS (TX) Oklahoma commit. Outstanding defensive SS who can hit. 6.4 speed in 60 yd. Touched 97 on mound. Son of former major leaguer. Five tool potential.
  • 2. Riley Greene 6-2, 190 OF Haggerty HS (FL) Florida commit.Best HS hitting prospect. LH bat with good eye, plate discipline and developing power.
  • 3. C.J. Abrams 6-2, 180 SS Blessed Trinity HS (GA) High-ceiling athlete. 70 speed with plus arm. Hitting needs to develop as he matures. Alabama commit.
  • 4. Reece Hinds 6-4, 210 SS Niceville HS (FL) Power bat, committed to LSU. Plus arm, solid enough bat to move to 3B down the road. 98MPH arm.
  • 5. Daniel Espino 6-3, 200 RHP Georgia Premier Academy (GA) LSU commit. Touches 98 on FB with wipe out SL.

2019 MLB Draft - Top College Draft Prospects

  • 1. Adley Rutschman C Oregon State Plus defender with great arm. Excellent receiver plus a switch hitter with some pop in the bat.
  • 2. Shea Langliers C Baylor Excelent throw and catch skills with good pop time. Quick bat, uses all fields approach with some pop.
  • 3. Zack Thompson 6-2 LHP Kentucky Missed time with an elbow issue. FB up to 95 with plenty of secondary stuff.
  • 4. Matt Wallner 6-5 OF Southern Miss Run producing bat plus mid to upper 90's FB closer. Power bat from the left side, athletic for size.
  • 5. Nick Lodolo LHP TCU Tall LHP, 95MPH FB and solid breaking stuff.