Calc Removing a number from a range

I am trying to automatically remove a number from a range of cells, if it
appears in a different range.

I am creating a spreadsheet where once a number appears in B4:G11 4 times, it
changes color to Red…got that part.

Then I want to manually enter that number somewhere into J4:N21. once entered
into J4:N21, i want that number to erase from B4:G11.

ideally at that point i would also like all remaining numbers in B4:G11 to
shift up, leaving no empty cells above cells with values in them (keeping them
in the order entered within columns).

You can not delete data from cells using the formula.
But you can display the data without the deleted values ​​elsewhere.
Typically use additional columns with formulas on a separate sheet for such operations.

See small example -
Removing a number from a range.ods