Diagnostic and monitoring applications using near infrared (NIR) spectroscopy in cancer and other diseases