Pros
Supervisors and management are generally friendly at the company, and they offer you a lot of flexibility with remote test item rating opportunities. Lots of documentation to outline specifically what they are seeking in rater responses.
Cons
Project work is feast or famine, so don't expect a steady, full-time schedule. Pay rates could be better, but far from predatory. Burnout is a real thing when you're assessing hundreds (thousands?) of items over short periods of time. Most competent raters can handle this kind of work, but I suspect it takes an extremely detail-oriented person who is passionate about assessment to make it all really worth it. So, if you're not someone with a high tolerance to repetition--and sometimes tedium--this might not be the best fit for you. Project work tends to be feast or famine, and this won't make you a steady income, but as far as part-time jobs pay, it's a pretty reasonable rate. Rater criteria is also ever-evolving, so don't be surprised if you have to retrain on some of the item categories.