"Skip untranslated strings" not working anymore?

In one of our Crowdin projects, we have the “Skip untranslated strings” option turned on and it usually works fine: translated files don’t include strings that were not translated. However, when I tried to sync our translations via the Github integration today, I saw that untranslated strings were being included as blank strings. Here’s an example commit, and here’s what that file looks like with these blank strings:

af:
  x_people_helped_user_with_y_ids_html: ""
  _100_day_trends:
  _percent_ID_d: ""
  a_community_for_naturalist:
  a_default_taxon_name_will_automatically_created: |
  a_flag_for_x: ""
  a_member_of_taxon_html: ""

This is a significant change in behavior and will result in a lot of our users seeing blank spaces where before they would have seen the default English source text. Is there a bug?

2 Likes

FWIW, I got in touch with Roman B. at Crowdin support and they said,

Yesterday we had a deployment in which there was a small error and it affected the update of files, our guys have already restored back everything. Tomorrow, our team will launch a special script that will go through all projects and fix files that may have been affected

So, problem isn’t solved yet but it sounds like someone’s working on it.

2 Likes

Heard the same in another topic. Yep, probably your problem is related to this. As I know Crowdin’s team are really fast, you can expect fix in a day or so.

1 Like

Hello. This problem seems to be happening also with the CLI. When I do a pull:
crowdin pull --skip-untranslated-strings the following string gets added to my translation files:

...
"SuperFreshString": "",
...

When in fact it is clear from the Crowdin UI that the String is not translated yet:

1 Like

I always use crowdin download for downloading translations, but not with this command, but with editing the crowdin.yaml (export options) file for this purpose Configuration File | Crowdin Developer Portal

So each file may have different options as I prefer.

Which version of CLI do you have installed? Or this is the GitHub actions? If you don’t want to separate the files by options, probably would be better to set up 1 time everything within project settings and just keep using it.

1 Like

I have the same problem! I’m using GitHub integration with an open source PHP project but “Skip untranslated strings” setting is ignored when syncing. The exported files have many empty strings.
Should this be fixed in the meantime? Or am I doing something wrong?

1 Like

Files are in .php format, right? Does project settings have same options as configuration file? I mean, in both project settings + configuration file should be the same option, otherwise project settings would replace the one you’ve specified in the config file.

Also, probably it’s a 1 time diff you need to accept (at least this is what I’ve done with .mdx files).

1 Like

Yes

Yes

What do you mean with “it’s a 1 time diff”? Do you refer to GitHub?
In my opinion it can’t be a GitHub problem because I also have this problem when simply downloading compiled translations.

1 Like

Hello @gadgetto does this issue can be reproduced with another file format or another php file? I mean, to see if it affects only yours file from Github, can you upload the sample (not in php) just via UI of Crowdin, add 1-2 random translation and download it so see if the option of skip works?

1 Like

Sorry for my late response!
I just created a new project (UserImport 2) which has the same file type (.php) to translate.

Same behavior! Untranslated strings aren’t skipped - they are included as empty strings.

Here is a sample from the source file:

$_lang['userimport.import_users_button_start']                  = 'Start import';
$_lang['userimport.import_users_status']                        = 'Import Status';
$_lang['userimport.import_users_msgbox_start_now']              = 'Start import now?';
$_lang['userimport.import_users_msgbox_start_now_desc']         = '<strong>It is recommended to backup the database before importing!</strong><br>Do you want to start the import process now?';
$_lang['userimport.import_users_msg_importing']                 = 'Importing...';
$_lang['userimport.import_users_msg_successfull']               = 'Import successfull';
$_lang['userimport.import_users_msg_failed']                    = 'Import failed';
$_lang['userimport.import_users_unique_import_key']             = 'Import-Key: ';
$_lang['userimport.import_users_row']                           = 'Row: ';

This is the result for untranslated strings:

$_lang['userimport.import_users_button_start']                  = 'Starte Import';
$_lang['userimport.import_users_status']                        = '';
$_lang['userimport.import_users_msgbox_start_now']              = '';
$_lang['userimport.import_users_msgbox_start_now_desc']         = '';
$_lang['userimport.import_users_msg_importing']                 = 'Importiere...';
$_lang['userimport.import_users_msg_successfull']               = '';
$_lang['userimport.import_users_msg_failed']                    = '';
$_lang['userimport.import_users_unique_import_key']             = '';
$_lang['userimport.import_users_row']                           = '';

Even languages with 0% translation contains the full list of language keys but with empty strings.

1 Like

Hello @gadgetto
From my side, I can see you have 2 projects, in 1 of them the export option is “skip untranslated files”, in 2 it is “skip untranslated strings”. If you speak about 1 project, it’s expected behavior.

1 Like

I had to setup project GoodNews 2 to “Skip untranslated files” as this was the only way to get usable result. “Skip untranslated strings” simply doesn’t work as expected.

The new project UserImport 2 currently is set to “Skip untranslated strings” to test this behavior. With the same result: Crowdin pushes translated files to GitHub with empty strings.

1 Like

To me it seems that your .php files are just in .php extension. By default skip strings is not applied to text documents: .docx, .pptx, .xlsx, etc., since missing texts may cause the resulting files to be unreadable. Maybe this is why that option is not working with your files? You tested in some other format?

1 Like

Hello @gadgetto

I just checked the files you’ve shared, and I can confirm that for those files skipping untranslated strings wouldn’t be working.

It is also stated in our KB, that PHP is exported with empty values → Project Settings | Crowdin Documentation

If you wish so, this application may help you to create Custom Exporter

1 Like

Thanks for your hint! So I’ll activated “Skip untranslated files” setting.

I’ts very strange that this should’t work as this is the default lexicon file format of MODX CMS. The MODX CMS (Revolution) and hundreds of plugins and add-ons are translated via Crowdin. I never heard of this problem.

Are there any plans to “fix” this? Or may I ask what’s the reason this feature isn’t available for PHP files?

1 Like

We use AST to import PHP files. This means that Crowdin would parse PHP code into a large object of entities, then go through the tree and catch entities that are translatable. This way Crowdin is able to translate all kinds of constructions that a client would come with, all syntax constructions that would allow storing translatable texts.

While this approach has a lot of advantages (for example, we can preserve parts of the file like comments or code that is useful but does not store translatable text) and the ability to literally support all ways of storing text that our clients would use, with this approach it is tricky to remove parts of the code.

The first thing that comes to my mind is to have a post-processor and strip lines that have empty translations. You can do this with a script:

  1. Download files
  2. Strip lines

Another way would be to use the Crowdin bundles feature. This feature would allow you to generate resource files from the list of objects Сrowdin would provide.

I can bring a tech person to consult you further on a possible development of a bundle exporter. If it is needed - please message me directly on the matter.

1 Like