Effective information retrieval is not provided with manual multimedia processing methods against huge amount of multimedia data which is produced in nowadays. Even automatic annotation generation methods are hard to address, they only operate on image processing step. Ultimately, it does not mean having a system that retrieve, relate and interpret the retrieved data. This study is done for filling the gap that is mentioned. In the study, inquiry is done by use of semantic web infrastructure on the produced, processed data of multimedia which is a source of ontologies. It is aimed to build a framework to introduce meaning on result data with semantic search. In this manner, it will be possible to access the knowledge effectively on multimedia datasets.