A new estimator has been developed that improves upon existing methods in linear regression. It builds upon a previous estimator and includes popular techniques like ordinary least squares and ridge regression. The new estimator was shown to have better performance in terms of accuracy and bias compared to the old methods. This was demonstrated through theoretical evaluations and numerical examples.