MathWorks interview question

Math questions onsite very a bit difficult.