Don't miss that Windows includes an application called Character Map which you can use to look up the alt codes and unicodes of thousands of different characters. These codes can be used in any Windows application.
Click on the 'Advanced view' check box and a search box will appear. You can enter the name of any character or symbol that you want to search for.
At the bottom of the window you'll see references to the unicode and alt character codes. In Word you can simply type the unicode four character alphanumeric code and then press ALT + X and the code will appear. To enter the alt code, simply press down the ALT key and then press the numbers on your keyboard's number pad.
The characters can also be selected and copied. You can add multiple characters to your clipboard to form complete words in Hebrew, Arabic and other languages.