ZnMgTe/ZnTe/ZnMgTe layered structures were grown on (0 0 1) ZnTe substrates by molecular beam epitaxy. This structure was designed to apply to waveguides in various optoelectronic devices to reduce light loss. Since the lattice mismatch between ZnTe and ZnMgTe was not negligible, the critical layer thickness (CLT) was theoretically derived. Structures with varying Mg composition and layer thickness of ZnMgTe cladding layer were grown and examined for crystal quality with respect to theoretical data. The crystal quality was investigated by means of cross sectional transmission electron microscopy (TEM) and reciprocal space mapping (RSM). Optical confinements were observed by irradiating a laser beam from one end of the sample and monitoring the transmitted light from the other end. (C) 2011 Elsevier B.V. All rights reserved.