In the upcoming evolution of the Internet of Things (IoT), it is anticipated that billions of devices will be connected to the Internet. While IoT promises a more connected and smarter world, this pervasive large-scale data collection, storage, sharing, and analysis raise many privacy concerns. In the current IoT ecosystem, IoT service providers have full control of the collected user data. They use the data for smart IoT system and device control. They could also use the data for other purposes not consented to by the users. This project proposes a novel data usage control framework, PrivacyGuard, that aims to empower data owners with full control over how their sensitive data is used so as to protect the data from certain types of privacy breaches. PrivacyGuard ensures that user data can only be used only by user-approved programs and each use of data has a non-repudiable usage record.