Ask Your Question
0

How can I select all Japanese text at once in a document that contians Japanese and computer code?

asked 2021-04-19 16:36:40 +0200

Sc123 gravatar image

updated 2021-04-19 16:54:09 +0200

I have a writer document that is ripped from a game file. It has character dialogue in the form of Japanese text, and also much computer code. I am interested in selecting all the Japanese text at once, and copying it to another document to translate it. Please let me know how/if this is possible.

edit retag flag offensive close merge delete

Comments

If your paragraphs are defined using the proper language use Edit -> Find and Replace, click button Format and select the language you want find in tab Font and click button Find All. If your paragraphs are not properly styled, I can't see a way (may be button Attributes in Edit -> Find and Replace could give a clue).

Opaque gravatar imageOpaque ( 2021-04-19 16:52:54 +0200 )edit

I did as you said, and it says "search key not found". Does that mean the paragraphs are not properly styled as you said?

Sc123 gravatar imageSc123 ( 2021-04-19 17:12:46 +0200 )edit
Mike Kaganski gravatar imageMike Kaganski ( 2021-04-19 17:46:36 +0200 )edit

@Mike Kaganski Well I'm trying to copy/cut and paste the Kanji, not delete them. Also I'm not sure if that accounts for Hiragana/Katakana? They are not found in China. Finally, it says "search key not found" when searching with the "[一-龥]" mentioned in that question.

Sc123 gravatar imageSc123 ( 2021-04-19 17:57:50 +0200 )edit

I'm trying to copy/cut and paste the Kanji, not delete them

Something tells me that both to copy, and to delete, one needs to select first. With some imagination, one could find hints how to select things there in the referenced article.

Also I'm not sure if that accounts for Hiragana/Katakana? They are not found in China

Please take a look at my answer there, where I discuss the character classes. And there are references to Unicode database with discussion of character properties.

Finally, it says "search key not found" when searching with the "[一-龥]" mentioned in that question.

Have you used regular expressions, as mentioned there?

Mike Kaganski gravatar imageMike Kaganski ( 2021-04-19 18:17:37 +0200 )edit

1 Answer

Sort by » oldest newest most voted
0

answered 2021-04-19 16:53:53 +0200

ajlittoz gravatar image

If your document is ripped off a game file, it is likely a .txt file without any embedded formatting directive. I hope it is UTF-8 encoded. It could use other encodings like JIS X 0201 or JIS X 0208.

I assume it is UTF-8 but the basic principle can be adapted to other encodings.

The easiest tool for your job is to use a text editor (the kind of editor used for programming) with regular expression find & replace. Don't use Writer which is not versatile enough for that.

Computer code usually uses ASCII characters (U+0000 to U+007F). Your Japanese dialogues will normally not contain ASCII characters (they can of course, but you'll have to check afterwards if your extraction seems to be lacking elements). Thus, you can use regexp to delete all ASCII characters from the text. What is left should be your non-Latin dialogues.

To show the community your question has been answered, click the ✓ next to the correct answer, and "upvote" by clicking on the ^ arrow of any helpful answers. These are the mechanisms for communicating the quality of the Q&A on this site. Thanks!

In case you need clarification, edit your question (not an answer which is reserved for solutions) or comment the relevant answer.

edit flag offensive delete link more

Comments

Let me clarify: The file was originally in ".mes" format, not ".txt". The encoding is in Shift-JIS. I selected the encoding as as such in Noetpad++, and copy/pasted all the text to writer. This translation will be text only(ie a script to be posted online at a later date), as the game uses many propriatary formats, and I have not been able to successfully repack the data, so I do not need the code intact. Since Noetpad++ was the editor I used, and considering my clarifications, should I ask their help section?

Sc123 gravatar imageSc123 ( 2021-04-19 17:01:39 +0200 )edit

I don't pratice Window$ but I think Notepad++ has regexp capability. If you can feed it with something equivalent to [^!-~] i.e. "not EXCLAMATION MARK to TILDE" (keeping spaces and all controls like linefeed and return), replacing with "nothing", that should do the trick.

If your dialogues do not contain spaces (I have no idea how kanji, hiragana or katakana is formatted), you can use [^ -~]. Similarly, if you want to keep some punctuation, adapt the content of the set.

Erratum: Shift JIS is an 8-bit encoding. This could make things easier. The regexp is [^!-[\[-}] to keep the yen sign at 0x5C and the overline at 0x7E. Again, this regexp keep controls and spaces which can be removed in a second step.

ajlittoz gravatar imageajlittoz ( 2021-04-19 17:37:45 +0200 )edit

If the text already is loaded into a Writer document, the encoding is no longer a problem.
Assuming any sequence of characters with codeplaces above U+00FF is "exotic" (Japanese in this case), but such text may probably contain one or two consecutive ASCII characters (like ordinary punctuation), Writer could find it with F&R/RegEx ([^\u0000-u\00FF]|(?<=[^\u0000-u\00FF])..?(?=[^\u0000-u\00FF]))*. Longer sequences of ASCII characters (than two) would be excluded.
Negative: ASCII except sequences shorter than 3 would be found by ([\u0000-u\00FF]){3,}

Lupp gravatar imageLupp ( 2021-04-19 18:19:39 +0200 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2021-04-19 16:36:40 +0200

Seen: 21 times

Last updated: Apr 19