Automatic detection and removal of weeds is a challenging task that requires precise sensors. While crops and weeds possess similar features in terms of appearance, they can be discriminated based on spectral information. This can be done because any object has its own specific spectral signature based on its physical structure and chemical contents. This study examined the use of wavelet transform and deep learning for discrimination of weeds from crops. A total of 626 spectral reflectances in the range of 380 to 1,000 nm were obtained for three crops (cucumber [Cucumis sativus L.], tomato [Solanum lycopersicum L.], and bell pepper [Capsicum annuum L.]) and five different weeds (bindweed [Convolvulus spp.], purple nutsedge [Cyperus rotundus L.], narrowleaf plantain [Plantago lanceolata L.], common cinquefoil [Potentilla simplex Michx.], and garden sorrel [Rumex acetosa L.]). Morse wavelet was employed to decompose the spectra and extract the scalograms, which are the RGB representations of the spectral data. Two deep convolutional neural networks (i.e., GoogLeNet and SqueezNet) were employed for the recognition of crops and weeds. In addition, six common classifiers, including linear discriminant analysis, quadratic discriminant analysis, linear support vector machine, quadratic support vector machine, artificial neural networks, and k-nearest neighbors classifier (KNN), were used for the task of crop/weed discrimination to build the comparison with the proposed method. The error of prediction gradually decreased, and a 100% correct classification was achieved after 258 iterations. Analysis showed that SqueezNet provided classification of 100% accuracy, while GoogLeNet's accuracy was 97.8% for the test set. Among the common classifiers, KNN provided the highest accuracy (i.e., 100%). This study showed that the proposed method can be successfully utilized for classification of crops and weeds.