Is it OK to initialize (create) mutexes, semaphores and queues before the scheduler has started?  It is clear to me that that you can not use them before starting the scheduler, but what about calling  xSemaphoreCreateMutex(), xQueueCreate() et cetera before the scheduler has started?

Creating queues, semaphores, mutexes, etc. before the scheduler has started is not a problem.