PyQt from py27 to py38

Wed Oct 27 10:11:30 BST 2021

Hi Tom,

thanks for this suggestion.
It could be very useful!
I'll try to include it in my code.
Thanks a lot!

Nicola
________________________________
From: Tomas Sobota <tom at sobota.net>
Sent: 26 October 2021 19:06
To: pyqt <pyqt at riverbankcomputing.com>
Subject: Re: PyQt from py27 to py38

A couple of ideas here:
https://stackoverflow.com/questions/54047757/unpickle-binary-file-to-text/54048296#54048296<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstackoverflow.com%2Fquestions%2F54047757%2Funpickle-binary-file-to-text%2F54048296%2354048296&data=04%7C01%7Cnicola.raffo%40rulex.ai%7C3852fe6cf0b5486d50a708d998a316e4%7Ccb4c9caf154d430fade0c36c8af22d19%7C0%7C0%7C637708648515960458%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=cMCJq5af4%2B7fhKyuoQ4%2BdM66Bf35PQ7YUx4sm%2BRDF%2F0%3D&reserved=0>
Maybe you could take it from there?
Tom

On Tue, Oct 26, 2021 at 6:12 PM RoadrunnerWMC <roadrunnerwmc at gmail.com<mailto:roadrunnerwmc at gmail.com>> wrote:
(Just adding this to the mailing list, if you don't mind)

---------- Forwarded message ---------
From: Nicola Raffo <nicola.raffo at rulex.ai<mailto:nicola.raffo at rulex.ai>>
Date: Tue, Oct 26, 2021 at 11:15 AM
Subject: Re: PyQt from py27 to py38
To: RoadrunnerWMC <roadrunnerwmc at gmail.com<mailto:roadrunnerwmc at gmail.com>>

Similar scenario here, I have to deal with some data stored with pickled PyQt4 objects. The pickletools method can be useful to "read" the pickled data, but I need a conversion from PyQt4 to PyQt5 data in order to be able to load the data in Python 3.8 and whitout a proper method to do it I can't depickle data in Python 3.8.

Another idea could be to use the previous version of the code which still uses python 2.7 and to store them in another format, but this could take a long time.

What I need is a tool that allows me to automatically read and open these data in Python 3.8
________________________________
From: RoadrunnerWMC <roadrunnerwmc at gmail.com<mailto:roadrunnerwmc at gmail.com>>
Sent: 26 October 2021 17:06
To: Florian Bruhin <me at the-compiler.org<mailto:me at the-compiler.org>>
Cc: pyqt at riverbankcomputing.com<mailto:pyqt at riverbankcomputing.com> <pyqt at riverbankcomputing.com<mailto:pyqt at riverbankcomputing.com>>
Subject: Re: PyQt from py27 to py38

The pickletools method is at least doable for relatively simple pickles -- I have an application that does exactly that because another developer made the less-than-wise decision to store pickled PyQt4 objects in user data files a long time ago, and now I have to support reading them forever. The main downside is that you have to make a lot of assumptions about the structure of the pickle data, ones which technically don't need to always be true, but should nevertheless be safe if your users are all using CPython and not manually messing with the generated pickle data for some reason.

There is another option, too, which is to make a minimal fake "PyQt4" interface (just a few nearly-empty class stubs) and have pickle load using that. I chose the pickletools method because of the additional security benefits of avoiding using pickle.loads() on untrusted user data files.

On Tue, Oct 26, 2021 at 8:58 AM Florian Bruhin <me at the-compiler.org<mailto:me at the-compiler.org>> wrote:
On Tue, Oct 26, 2021 at 11:47:40AM +0200, Florian Bruhin wrote:
> The harder way is to somehow coerce pickle into giving you the "raw"
> data without the PyQt object involved...

I just learned there's 'pickletools' in the stdlib:
https://docs.python.org/3/library/pickletools.html<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.python.org%2F3%2Flibrary%2Fpickletools.html&data=04%7C01%7Cnicola.raffo%40rulex.ai%7C3852fe6cf0b5486d50a708d998a316e4%7Ccb4c9caf154d430fade0c36c8af22d19%7C0%7C0%7C637708648515970475%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=kWviYMBK7fKXRImQ1PIPcfYeD4tRLqthi%2BCK%2BPp0YWQ%3D&reserved=0>

Using that, you could inspect the pickle manually and pick the data out
of it somehow. Given how pickles are structured, not exactly
straightfoward either, though.

Florian

--
            me at the-compiler.org<mailto:me at the-compiler.org> | https://www.qutebrowser.org<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.qutebrowser.org%2F&data=04%7C01%7Cnicola.raffo%40rulex.ai%7C3852fe6cf0b5486d50a708d998a316e4%7Ccb4c9caf154d430fade0c36c8af22d19%7C0%7C0%7C637708648515970475%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=cO92p%2B5mwXxrbHxRTDq9iu59HTTDyX5vdHdtqIOhkbQ%3D&reserved=0>
       https://bruhin.software/<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbruhin.software%2F&data=04%7C01%7Cnicola.raffo%40rulex.ai%7C3852fe6cf0b5486d50a708d998a316e4%7Ccb4c9caf154d430fade0c36c8af22d19%7C0%7C0%7C637708648515980455%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=xOidogl3P5oLS5X02yWnJHU3iCsst6FGlOUEQ7sRzng%3D&reserved=0> | https://github.com/sponsors/The-Compiler/<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fsponsors%2FThe-Compiler%2F&data=04%7C01%7Cnicola.raffo%40rulex.ai%7C3852fe6cf0b5486d50a708d998a316e4%7Ccb4c9caf154d430fade0c36c8af22d19%7C0%7C0%7C637708648515990436%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=o%2B8MO1Rtf3uumPCRrgOjqr9kf3VsNRGLV%2BgfevuE9mk%3D&reserved=0>
       GPG: 916E B0C8 FD55 A072 | https://the-compiler.org/pubkey.asc<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fthe-compiler.org%2Fpubkey.asc&data=04%7C01%7Cnicola.raffo%40rulex.ai%7C3852fe6cf0b5486d50a708d998a316e4%7Ccb4c9caf154d430fade0c36c8af22d19%7C0%7C0%7C637708648515990436%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=QiQ05Pxt1xn0ppnrRiZ4NG7CFuRjUHyyDgLc0F68SGY%3D&reserved=0>
             I love long mails! | https://email.is-not-s.ms/<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Femail.is-not-s.ms%2F&data=04%7C01%7Cnicola.raffo%40rulex.ai%7C3852fe6cf0b5486d50a708d998a316e4%7Ccb4c9caf154d430fade0c36c8af22d19%7C0%7C0%7C637708648516000434%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=gpD8G2TqDaAqqWGRUCeHp1B9ykp4qpMeY2iFc%2F4LXTY%3D&reserved=0>

--

Nicola Raffo

Senior Product Development Specialist

RuleX<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Frulex.ai%2F&data=04%7C01%7Cnicola.raffo%40rulex.ai%7C3852fe6cf0b5486d50a708d998a316e4%7Ccb4c9caf154d430fade0c36c8af22d19%7C0%7C0%7C637708648516010428%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=J1W0tkvm2Axpmggaan3Sev6KwkRREEQzrx7E%2BCpyj4g%3D&reserved=0>

+39 010 8050 190

PLEASE NOTE: This e-mail and any attachments may be confidential or privileged and is intended solely for the addressee(s). Do not share or use without Rulex's approval. If received in error, please contact the sender and delete the email and any attachments.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.riverbankcomputing.com/pipermail/pyqt/attachments/20211027/9c454431/attachment-0001.htm>