Bug 391932 - Google source of stock quotes quit
Summary: Google source of stock quotes quit
Status: RESOLVED WORKSFORME
Alias: None
Product: kmymoney
Classification: Applications
Component: general (show other bugs)
Version: 4.8.1
Platform: Microsoft Windows Microsoft Windows
: NOR normal
Target Milestone: ---
Assignee: KMyMoney Devel Mailing List
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2018-03-16 13:57 UTC by akoolwine
Modified: 2022-12-18 05:15 UTC (History)
4 users (show)

See Also:
Latest Commit:
Version Fixed In:


Attachments
attachment-11827-0.html (1.68 KB, text/html)
2018-03-25 23:27 UTC, Brendan
Details
attachment-26790-0.html (2.34 KB, text/html)
2022-11-18 04:55 UTC, akoolwine
Details

Note You need to log in before you can comment on or make changes to this bug.
Description akoolwine 2018-03-16 13:57:50 UTC
Switched to Google as source of quotes for stocks as per the fix. This has been working well for some time. It quit yesterday - 2018-03-15 - for stocks, still gets exchange rates.
Comment 1 akoolwine 2018-03-16 19:06:41 UTC
This was the format of the request & the response:

Fetching URL https://finance.google.com/finance?q=TSE:XEC...
The file or folder https://finance.google.com/search?q=TSE:XEC does not exist.
Unable to update price for TSE:XEC (empty quote data)
Comment 2 lp.allard.1 2018-03-25 20:06:50 UTC
Same here on 4.7.2 (inux Mint).

Yahoo stopped working a while ago, so I managed to move to Google to retrieve stock and currency quotes which also seems to have stopped working in the last little while (was working about 2 or 3 weeks ago I updated the prices back then).

Now for both stock prices and currency I get

Fetching URL https://finance.google.com/finance?q=GBPCAD...
Unable to update price for GBP > CAD (no price or no date)
Fetching URL https://finance.google.com/finance?q=NASDAQ:%20TQQQ...
Unable to update price for NASDAQ: TQQQ (no price or no date)

Why are price updates so difficult to get working nowadays??
Comment 3 Jack 2018-03-25 20:30:11 UTC
(In reply to lp.allard.1 from comment #2: Why are price updates so difficult to get working nowadays??)

There are really two very different parts to that question.  The second is whether KMM can update prices if it has an available source for the data.  I hope this is not the point of your question, as this is not the reason for the problem.

The first, and critical, question is why is it so hard to find a free, reliable source of price update data on the web?  I don't have a good answer to this, but without an actual source to point at, KMyMoney doesn't have any magic it can use to find price update data.
Comment 4 Michael Carpino 2018-03-25 22:08:19 UTC
There's a solution using Yahoo for Quotes.  It was posted on March 17th on the forum.  I started using it yesterday and it works fine.   Here's a link to the post https://forum.kde.org/viewtopic.php?f=69&t=142713&start=15
Comment 5 Brendan 2018-03-25 23:27:39 UTC
Created attachment 111655 [details]
attachment-11827-0.html

It works great for me too. Fastest downloads ever for stock prices.

---
Brendan Coupe

On Sun, Mar 25, 2018, 4:08 PM Michael Carpino <bugzilla_noreply@kde.org>
wrote:

> https://bugs.kde.org/show_bug.cgi?id=391932
>
> Michael Carpino <mfcarpino@gmail.com> changed:
>
>            What    |Removed                     |Added
>
> ----------------------------------------------------------------------------
>                  CC|                            |mfcarpino@gmail.com
>
> --- Comment #4 from Michael Carpino <mfcarpino@gmail.com> ---
> There's a solution using Yahoo for Quotes.  It was posted on March 17th on
> the
> forum.  I started using it yesterday and it works fine.   Here's a link to
> the
> post https://forum.kde.org/viewtopic.php?f=69&t=142713&start=15
>
> --
> You are receiving this mail because:
> You are the assignee for the bug.
Comment 6 lp.allard.1 2018-03-26 01:19:16 UTC
(In reply to Jack from comment #3)
> (In reply to lp.allard.1 from comment #2: Why are price updates so difficult
> to get working nowadays??)
> 
> There are really two very different parts to that question.  The second is
> whether KMM can update prices if it has an available source for the data.  I
> hope this is not the point of your question, as this is not the reason for
> the problem.
> 
> The first, and critical, question is why is it so hard to find a free,
> reliable source of price update data on the web?  I don't have a good answer
> to this, but without an actual source to point at, KMyMoney doesn't have any
> magic it can use to find price update data.

JAck,  never would imply KMM is badly coded, Ive been a user for 10+ years now and will likely continue!  Yes I meant why are sources so unreliable?  I  guess even the big players (Yanoo, Google) are unreliable, and they do what they want...

Anyways, I'm trying to re-use Yahoo from the forum post available at https://forum.kde.org/viewtopic.php?f=69&t=142713&start=15 from Michael Carpino, right now I have firewall issues, I will reply once I get it working.
Comment 7 lp.allard.1 2018-03-27 01:46:03 UTC
OK the fix at https://forum.kde.org/viewtopic.php?f=69&t=142713&start=15 worked for Yahoo!

Now Globe & mail ceased to work.  Pathetic.  They changed their URL's, they used to use numeric identifiers (like theglobeandmail.com/lablabla/12345) now they are using theglobeandmail.com/investing/markets/funds/AIM9967.CF/

Just changing the ticker ID in the investment doesnt work.  They must have changed the REGEX as well.

I STRONGLY recommend the KMM devs implement a REGEX Wiki that will be actively maintained for the most popular price sources (google, globe and mail, Yahoo, etc).  Once a source stops to work, we could go to the wiki and see if something changed.  Right now this is impossible there's info on forums, here in multiple tickets, etc...
Comment 8 Michael Carpino 2018-03-27 12:18:11 UTC
(In reply to lp.allard.1 from comment #7)
> OK the fix at https://forum.kde.org/viewtopic.php?f=69&t=142713&start=15
> worked for Yahoo!
> 
> Now Globe & mail ceased to work.  Pathetic.  They changed their URL's, they
> used to use numeric identifiers (like theglobeandmail.com/lablabla/12345)
> now they are using theglobeandmail.com/investing/markets/funds/AIM9967.CF/
> 
> Just changing the ticker ID in the investment doesnt work.  They must have
> changed the REGEX as well.
> 
> I STRONGLY recommend the KMM devs implement a REGEX Wiki that will be
> actively maintained for the most popular price sources (google, globe and
> mail, Yahoo, etc).  Once a source stops to work, we could go to the wiki and
> see if something changed.  Right now this is impossible there's info on
> forums, here in multiple tickets, etc...

I find your choice of words, like pathetic & impossible to be inappropriate for this post.  Have you made any financial contributions to the individuals that take their personal time to code this software?  Time where they could be doing other activities (visiting with family & friends, doing personal activities, etc) If not then maybe you should consider being a little more gracious to their hard work and the efforts they put in.  This software is free and led by a volunteer group that should be supported by an understanding, considerate community. A community that supports each other and shares ideas respectfully when they are needed and become available.  I personally shared with you a solution for your needs and frankly next time I'll let someone else volunteer.
Comment 9 Danny Scott 2018-03-27 12:43:34 UTC
I believe the "pathetic" was aimed at Globe and Mail, not at kmymoney.

The online sources are intended to be accessed by individuals, and not extracted by software, so they all keep changing things up to stay ahead of not just kmymoney but anyone trying to harvest data.

There is a wiki https://userbase.kde.org/KMyMoney which I haven't used myself, but it should be possible for anyone to create a topic there for users to update methods for various sources.
Comment 10 lp.allard.1 2018-03-27 23:06:50 UTC
Sorry Michael for triggering you so hard.  I was of course not talking about KMM.  KMM is a great project and in the past I submitted multiple bug reports in hope of making it better.  I have been using it since 2008.

Sorry for the misunderstanding.  The solution you posted for Yahoo worked as I pointed out in an earlier comment.  What I failed to do was to personally thank you for the solution.  Thank you for the solution, it was a quality solution!

Yes Danny you are correct.  When using the words "pathetic" and "impossible" I was referring to the sources (Yahoo, G&M, Google) which seems to be changing constantly.  My suggestion for the Wiki was a genuine one, I feel if the sources keep changing like this, it will be a lot easier for everyone to simply have a look at the wiki and see if the source settings have changed or not instead of posting bug tickets, forum posts, exchange emails with the maillist, etc.  Less traffic so to speak.

My 2 cents.
Comment 11 Brendan 2018-03-27 23:41:55 UTC
I'm not sure how much a wiki would reduce traffic since many people
might still come here and end up getting a link to the wiki rather
than the specific fix. I guess those of us that are not devs could
lend a hand with easy questions like this.

I would go one step further when things settle down and the devs have
a chance to add features. How about having KMM retrieve the settings
for some or all of the sources for quotes remotely so that changes
only have to be entered on the KMM server once and they propagate to
the clients automatically. This may require major code changes and
needs to be carefully thought out to prevent hackers from taking
advantage of it. Or maybe a plugin that gets updated without having to
upgrade the entire program. I know that this is all happening when the
devs have more important things to do (like help me get KF5 running!).

I agree the situation has gotten pretty pathetic (to be clear, not
KMM's fault) but maybe the Yahoo problem is a one time Verizon caused
problem and this will settle down now. When a LibreOffice extension I
was using to get quotes from Yahoo stopped working I switched to
Google quotes and they died at the same time that the KMM Google fixed
died. This is affecting more than KMM.

Food for thought.

----
Brendan Coupe


On Tue, Mar 27, 2018 at 5:06 PM,  <bugzilla_noreply@kde.org> wrote:
> https://bugs.kde.org/show_bug.cgi?id=391932
>
> --- Comment #10 from lp.allard.1@gmail.com ---
> Sorry Michael for triggering you so hard.  I was of course not talking about
> KMM.  KMM is a great project and in the past I submitted multiple bug reports
> in hope of making it better.  I have been using it since 2008.
>
> Sorry for the misunderstanding.  The solution you posted for Yahoo worked as I
> pointed out in an earlier comment.  What I failed to do was to personally thank
> you for the solution.  Thank you for the solution, it was a quality solution!
>
> Yes Danny you are correct.  When using the words "pathetic" and "impossible" I
> was referring to the sources (Yahoo, G&M, Google) which seems to be changing
> constantly.  My suggestion for the Wiki was a genuine one, I feel if the
> sources keep changing like this, it will be a lot easier for everyone to simply
> have a look at the wiki and see if the source settings have changed or not
> instead of posting bug tickets, forum posts, exchange emails with the maillist,
> etc.  Less traffic so to speak.
>
> My 2 cents.
>
> --
> You are receiving this mail because:
> You are the assignee for the bug.
Comment 12 NSLW 2018-03-28 09:16:09 UTC
In my opinion the only easy to use and reliable solution would be to use GHNS as it has been suggested in bug #259693. That would require some rework of online quote sources in KMM to support sources versioning and updating. In the end we would get source of online quotes sources available on the spot, independently from KMM releases. GHNS would be maintained by KMM developers, but I think it's possibile for users to create additional content independently.
Comment 13 Thomas Baumgart 2018-03-28 09:34:38 UTC
If somethinks about implementing it, it would make sense to move the actual work logic into LibAlkimia as it might be of interest for other applications as well. https://community.kde.org/Alkimia/libalkimia already mentions "Online Quotes" as one of the areas.
Comment 14 lp.allard.1 2018-04-01 00:55:43 UTC
OK I checked with G&M, and it turns out for whatever reason, some of the mutual funds I have are no longer listed on their database.  Its a bunch of funds owned at a single investment cabinet, all my other funds/stocks are updating fine.

BTW Yahoo is much faster with the proposed config.

On a different but unrelated note, I try to manually update prices for those that no longer update with online sources.  I select "Manually update price" from the investment, a window appears, I enter the price then pick a date, then click OK.  The price doesnt change.

A bug or am I doing something wrong?
Comment 15 Justin Zobel 2022-11-18 04:30:15 UTC
Thank you for reporting this issue in KDE software. As it has been a while since this issue was reported, can we please ask you to see if you can reproduce the issue with a recent software version?

If you can reproduce the issue, please change the status to "REPORTED" when replying. Thank you!
Comment 16 akoolwine 2022-11-18 04:55:37 UTC
Created attachment 153853 [details]
attachment-26790-0.html

Justin, can’t reproduce the problem…Art

Be yourself, everyone else is taken.
________________________________
From: Justin Zobel <bugzilla_noreply@kde.org>
Sent: Thursday, November 17, 2022 11:30:15 PM
To: akoolwine@gmail.com <akoolwine@gmail.com>
Subject: [kmymoney] [Bug 391932] Google source of stock quotes quit

https://bugs.kde.org/show_bug.cgi?id=391932

Justin Zobel <justin.zobel@gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|---                         |WAITINGFORINFO
             Status|REPORTED                    |NEEDSINFO

--- Comment #15 from Justin Zobel <justin.zobel@gmail.com> ---
Thank you for reporting this issue in KDE software. As it has been a while
since this issue was reported, can we please ask you to see if you can
reproduce the issue with a recent software version?

If you can reproduce the issue, please change the status to "REPORTED" when
replying. Thank you!

--
You are receiving this mail because:
You are on the CC list for the bug.
You reported the bug.
Comment 17 Bug Janitor Service 2022-12-03 05:17:44 UTC
Dear Bug Submitter,

This bug has been in NEEDSINFO status with no change for at least
15 days. Please provide the requested information as soon as
possible and set the bug status as REPORTED. Due to regular bug
tracker maintenance, if the bug is still in NEEDSINFO status with
no change in 30 days the bug will be closed as RESOLVED > WORKSFORME
due to lack of needed information.

For more information about our bug triaging procedures please read the
wiki located here:
https://community.kde.org/Guidelines_and_HOWTOs/Bug_triaging

If you have already provided the requested information, please
mark the bug as REPORTED so that the KDE team knows that the bug is
ready to be confirmed.

Thank you for helping us make KDE software even better for everyone!
Comment 18 Bug Janitor Service 2022-12-18 05:15:48 UTC
This bug has been in NEEDSINFO status with no change for at least
30 days. The bug is now closed as RESOLVED > WORKSFORME
due to lack of needed information.

For more information about our bug triaging procedures please read the
wiki located here:
https://community.kde.org/Guidelines_and_HOWTOs/Bug_triaging

Thank you for helping us make KDE software even better for everyone!