In this paper, we investigate a type of anisotropic, acoustic complementary metamaterial (CMM) and its application in restoring acoustic fields distorted by aberrating layers. The proposed quasi two-dimensional (2D), nonresonant CMM consists of unit cells formed by membranes and side branches with open ends. Simultaneously, anisotropic and negative density is achieved by assigning membranes facing each direction ( and directions) different thicknesses, while the compressibility is tuned by the side branches. Numerical examples demonstrate that the CMM, when placed adjacent to a strongly aberrating layer, could acoustically cancel out that aberrating layer. This leads to dramatically reduced acoustic field distortion and enhanced sound transmission, therefore virtually removing the layer in a noninvasive manner. In the example where a focused beam is studied, using the CMM, the acoustic intensity at the focus is increased from 28% to 88% of the intensity in the control case (in the absence of the aberrating layer and the CMM). The proposed acoustic CMM has a wide realm of potential applications, such as cloaking, all-angle antireflection layers, ultrasound imaging, detection, and treatment through aberrating layers.