Abstract: Generalized frequency division multiplexing (GFDM) is a new type of non-orthogonal multi-carrier modulation technology. Aiming at the strict matching of the parameters of the shaping filter at the transmitting end and the receiving end of the GFDM system, an adaptive estimation method of shaping filter parameters based on the received signal was proposed. The received signal was processed by windowing and moving average to reduce the influence of noise, and the filter parameters were estimated by comparing with the minimum mean square error of the frequency domain response of the filter under different preset parameter settings; Two methods, basic serial interference cancellation (one-sided) and bilateral interference cancellation (two-sided), were introduced to eliminate the inter carrier interference (ICI) in GFDM system, and the estimation performance of filter parameters under the two methods was compared and analyzed. The results show that the parameter estimation performance of the filter based on the bilateral interference cancellation method is better. Under the condition of high signal to noise ratio, the parameter estimation accuracy is more than 80%, and the bit error rate (BER) performance reaches the accuracy of 10^-4, and it has higher flexibility under complex channel conditions.