This paper proposes nodal displacement smoothing method for preventing the numerical instability during the topology optimization method. Since the tangent stiffness matrix often becomes negative definite or indefinite with the topological variable in geometrically nonlinear finite element analysis, the analysis results can be inaccurate or even cannot be obtained. To resolve this problem, the proposed method detects the distorted elements and calibrates these elements. To verify the effectiveness of this method, a design example of topology optimization with the large deformation is provided.