Images not deleted from SFTP external storage

[Hubertus]

I've just enabled SFTP external storage, and upload is working.
Problem:
After deleting images from admin portal with Success, they are still remaining on remote storage.

How can I debug this?

 

[Rodolfo]

Debug | V3 Docs

Documentation for Chevereto image hosting software (V3)

chevereto.com

 

[Hubertus]

I did see that, and used. Still no errors, can we trace what cheve is doing when I delete image from admin panel? What steeps are taken to delete image from SFTP? Is it working correctly on custom ports?

How we can solve problem with delete functionality, when cheve is not showing error?

 

[Rodolfo]

Chevereto only communicates with your external server. If the target server doesn't respond or isn't working properly is something that you have to detect in the external server logs.

Most likely the permissions are wrong or you have something on top like a cache.

Check the queue table, if that's empty then your SFTP is not even reporting the errors back to Chevereto. If the table has several rows, pay attention to the attempts column, that tells you how many times Chevereto sent the delete command to your server and failed.

Knowing that I can hint you in the next step.

 

[Hubertus]

When I login to the target server using SFTP user, I can upload, change and delete files.


queues table:
17206 rows, most are old. But few for delete from SFTP:

|    25396 | storage-delete | 2019-03-25 13:16:53 | {"key":"2019\/03\/25\/image_name.png","size":73186}                                                                                                                                             |          5 | 0              | pending      |

 

[Rodolfo]

17206 rows, most are old. But few for delete from SFTP:

Show me the rows, please. I don't have access to your server, I can't guess the bugs. I need input.

 

[Hubertus]

I did show you one example row in previous post, here are few of the latest:

|    25407 | storage-delete | 2019-03-27 13:39:22 | {"key":"2019\/03\/27\/name_xxx.jpg","size":910653}                                                                                                                                                                     |          5 | 0              | pending      |
|    25408 | storage-delete | 2019-03-27 13:39:22 | {"key":"2019\/03\/27\/name_xxx.th.jpg","size":"11083"}                                                                                                                                                                 |          5 | 0              | pending      |
|    25409 | storage-delete | 2019-03-27 13:39:22 | {"key":"2019\/03\/27\/name_xxx.md.jpg","size":"45154"}                                                                                                                                                                 |          5 | 0              | pending      |
|    25410 | storage-delete | 2019-03-28 13:27:42 | {"key":"2019\/03\/28\/name_xyz.jpg","size":1099452}                                                                                                                                                                   |          5 | 0              | pending      |
|    25411 | storage-delete | 2019-03-28 13:27:42 | {"key":"2019\/03\/28\/name_xyz.th.jpg","size":"8314"}                                                                                                                                                                 |          5 | 0              | pending      |
|    25412 | storage-delete | 2019-03-28 13:27:42 | {"key":"2019\/03\/28\/name_xyz.md.jpg","size":"258393"}                                                                                                                                                               |          5 | 0              | pending      |

 

[Rodolfo]

Please, the whole rows.

 

[Hubertus]

This are the whole rows, scroll right to see all. Im using select * from table;

 

[Rodolfo]

The chv_queue table has this structure:



And I'm expecting to see the all columns:



queue_attempts counts the times that Chevereto tried to issue the delete command in your SFTP but failed. If you don't have any row with queue_attempts value means that your external server never reported back the error and just told "OK" to Chevereto.

Why your server does that is not something that I can answer you. Start by trying with other SFTP servers (in several different providers) and maybe compare them later to find your conflicting setting. Most likely your external SFTP is just rejecting

You could try sending me the SFTP credentials (private message) so I can test if I can replicate the issue or not, but if your external storage is the problem then I won't get any error either.

 

[svs]

I've just enabled SFTP external storage, and upload is working.
Problem:
After deleting images from admin portal with Success, they are still remaining on remote storage.

How can I debug this?

Is there any progress in this issue? Same problem. External SFTP (OpenSSH) upload is OK, but files are not deleted. There are no errors anywhere, the queue table is empty.

 

[imghut]

I have tested this on my STFP storage and images ARE deleted, have you tried logging in to SFTP with the same account on an SFTP client such as Cyberduck, see if you can deleted the images yourself with that account, then you will know it's a permission problem.

 

[svs]

It's very strange... I have already set the 0000 mask in the SFTP config. Not deleted. Tried the console client-OK. Even connected this SFTP to other script (Nextcloud, with the same account parameters and being on the same hosting) - from there too files are deleted without errors. Chevereto reports OK and files disappear from all visibility lists, but on SFTP remain. Where else can I check?

 

[Wink]

Try to open app/lib/classes/class.sftp.php and change function deleteMultiple() to this:

    public function deleteMultiple(array $files=[])
    {
        $this->checkResource();
        if (count($files) == 0) {
            throw new SftpException("Missing or invalid array argument in " . __METHOD__, 200);
        }
        foreach ($files as $f) $this->sftp->delete($f, false);
        return $files;
    }

 

[Rodolfo]

Try to open app/lib/classes/class.sftp.php and change function deleteMultiple() to this:

    public function deleteMultiple(array $files=[])
    {
        $this->checkResource();
        if (count($files) == 0) {
            throw new SftpException("Missing or invalid array argument in " . __METHOD__, 200);
        }
        foreach ($files as $f) $this->sftp->delete($f, false);
        return $files;
    }

Let me know if this works. If does, I can add the command + the instructions used here.

 

[svs]

Yes! That solved the problem! Thank you very much!

 

[svs]

And everything was fine until the 3.15 update came out ((

 

[Rodolfo]

And everything was fine until the 3.15 update came out ((

Unfortunately I forgot to update the alleged code. You should update to this https://chevereto.com/community/thr...d-from-sftp-external-storage.11093/post-60946

 

[svs]

Yes, I did, it helped again. Just as a reminder, I'm not the only one with this problem...

 

[svs]

deleteMultiple

После обновления до 3.18 даже указанное выше редактирование кода не помогает ((