They were specified based on theoretical arguments. To assume they are negligible because of insignificant statistical tests runs into the well-known problem of accepting the null hypothesis. There are a number of reasons why their magnitude may be insignificant even though there exist a true underlying relationship: restriction of range of the variables, insufficient powere of the tests, inflated standard error due to collinearity.