Fetch Softworks

Automator - Get Fetch Folder Contents - encountered an error (10 posts)

• Started 6 years ago by Paul
• Latest reply 6 years ago from Jim Matthews

• Paul Member

  Hello -

  I seem to be having a problem with an Automator configuration. I've defined and created a Calendar workflow/application that runs 2 times a day. All it does is execute an sftp command and logs into a directory into a server and if a specific file exists (it filters it using name and type) then it removes it.

  My configuration is 10.11.6 and Fetch 5.7.6.

  The workflow runs fine at 5:15 pm and fails at 12:10AM. Now - I am stuck. Any pointers will help. The thing is I have the same workflow kick in from under machine running 10.10.x and its defined to run at 5:30pm and 12:20 AM (basically primary and secondary systems to ensure 1 always runs). And this works like 75% of the time at 12:20AM and fails sometimes at the same "The action Get Fetch Folder Contents" encountered an error".

  So what can I do? Any help will be much appreciated.

  Posted 6 years ago #

• Jim Matthews Administrator

  Hi,

  Does the workflow work when you run it in Automator?

  When you see a failure, could you choose "Fetch Transcript" from the Window menu and post the contents?

  Thanks,

  Jim Matthews
  Fetch Softworks

  Posted 6 years ago #

• Paul Member

  Hi Jim -

  So last night or actually at 12:10AM the Workflow executed without a problem. No errors at all. When the workflow executes, it also sends an email out confirming that it did work. I would like to explain a little more deeper (the background). For a number of years I've setup a system using Fetch and its automator actions to do something very simple (please see below):

  #1. Upload a file to a server at a certain time during the day (everyday)
  #2. Then delete the file from a server at a certain time during the day (everyday)
  #3. Download a file from a server if a new file resides at a certain time during the day (everyday)
  #4. Then delete the file from a server at a certain time during the day (everyday)

  This has run for years without a problem (I've had to update for changed passwords, certificates, different ftps/tls/sftp protocol) and I havent changed the OS and maybe updated Fetch a few times (newer version).

  I've added a backup system to the above so that I have a primary and a backup (in case 1 fails the other runs) and the primary and backup run at different times.

  But lately the primary and backup seem to failing regularly at the odd 12:10AM or 12:30AM time when it executes the "Delete the file" (refer to step #4 listed above) and its always at "Get Fetch Folder Contents".

  I'm beginning to think its some kind of networking error now Maybe (but I have 2 separate connections at different times)? Can i make sure the connection is kept live? Any pointers?

  Thanks

  Posted 6 years ago #

• Jim Matthews Administrator

  Hi,

  The contents of the Fetch Transcript window would help clarify whether it's a networking error. It might be difficult to keep the connection alive for hours; most FTP servers drop connections if it's been a while since the last data transfer, so you'd probably have to upload or download a file every 30 minutes or so just to keep the server from dropping the connection.

  Thanks,

  Jim Matthews
  Fetch Softworks

  Posted 6 years ago #

• Paul Member

  Hi Jim -

  So the process to delete the file failed again from this machine that only runs the Fetch Automator action to delete the file that exists. I am listing the Fetch Transcript below (I've masked the server names)

  ****

  Fetch 5.7.6 (5H1671) Intel (Web Store) running on Mac OS X 10.11.6 (15G1510) Intel English
  StuffIt Engine 0x820, StuffIt SDK Version 10.1.1b1
  Partial serial FETCHXXXXXXX
  Connecting to YYY@rZZZ.com port 22 (5/30/17, 00:10)
  SSH2_FXP_INIT 3
  Connecting to YYY@rZZZ.com port 22 (5/30/17, 00:10)
  SSH2_FXP_INIT 3
  Update check skipped at 5/30/17, 00:12 (next check after 5/30/17, 22:19)

  ****

  The Automator Action shows "Get Fetch Folder Contents encountered an error"

  In response to your Keeping the connection alive. Its simply connects to the server and immediately executes the Fetch Automator action to Filter the contents and delete a certain named file.

  The Fetch transcript doesn't show much. Is there some kind of log I can look into? This is running on 10.11.6.

  Thanks

  Posted 6 years ago #

• Jim Matthews Administrator

  It is odd that there's no error in the transcript. You could look at the Fetch.log file. To find Fetch.log:

  1) Open Fetch
  2) Choose "Fetch Transcript" from the Window menu
  3) Choose "Show Fetch.log in Finder" from the File menu

  Thanks,

  Jim Matthews
  Fetch Softworks

  Posted 6 years ago #

• Paul Member

  Hi Jim -

  I'm posting the log of the specific date/time when the error occurred:

  ***** Log start

  2017-05-29 17:16:26,078 Fetch 5.7.6 (5H1671): DEBUG All logs closed
  2017-05-30 00:10:14,555 Fetch 5.7.6 (5H1671): DEBUG === Fetch launching ===
  2017-05-30 00:10:14,556 Fetch 5.7.6 (5H1671): DEBUG Initialized exception logging
  2017-05-30 00:10:14,556 Fetch 5.7.6 (5H1671): DEBUG App starting
  2017-05-30 00:10:14,556 Fetch 5.7.6 (5H1671): DEBUG Found font named Lucida Grande (Full) -- file /System/Library/Fonts/LucidaGrande.ttc
  2017-05-30 00:10:14,556 Fetch 5.7.6 (5H1671): DEBUG Copyright: Copyright � 1989 Bigelow & Holmes, Inc. All rights reserved. Lucida is a trademark of Bigelow & Holmes Inc. registered in the U.S. Patent and Trademark Office and other jurisdictions. Lucida typeface designs created by Kris Holmes and Charles Bigelow.
  2017-05-30 00:10:14,556 Fetch 5.7.6 (5H1671): DEBUG Family: Lucida Grande
  2017-05-30 00:10:14,556 Fetch 5.7.6 (5H1671): DEBUG Style: Regular
  2017-05-30 00:10:14,556 Fetch 5.7.6 (5H1671): DEBUG Unique: Lucida Grande; 10.0d1e2; 2014-09-12
  2017-05-30 00:10:14,557 Fetch 5.7.6 (5H1671): DEBUG Full: Lucida Grande
  2017-05-30 00:10:14,557 Fetch 5.7.6 (5H1671): DEBUG Version: 10.0d1e2
  2017-05-30 00:10:14,557 Fetch 5.7.6 (5H1671): DEBUG Postscript: LucidaGrande
  2017-05-30 00:10:14,557 Fetch 5.7.6 (5H1671): DEBUG Trademark: Lucida is a registered trademark of Bigelow & Holmes Inc.
  2017-05-30 00:10:14,557 Fetch 5.7.6 (5H1671): DEBUG Designer: Kris Holmes and Charles Bigelow
  2017-05-30 00:10:14,557 Fetch 5.7.6 (5H1671): DEBUG Vendor URL: http://www.agfamonotype.com
  2017-05-30 00:10:14,557 Fetch 5.7.6 (5H1671): DEBUG Designer URL: www.bigelowandholmes.com
  2017-05-30 00:10:14,557 Fetch 5.7.6 (5H1671): DEBUG License description: Do not copy. Call USA 847-718-0400 UK 44(0)1737 765959.
  2017-05-30 00:10:14,557 Fetch 5.7.6 (5H1671): DEBUG License info URL: http://www.agfamonotype.com/html/type/license.html
  2017-05-30 00:10:14,670 Fetch 5.7.6 (5H1671): DEBUG Found font named Lucida Grande (Full) -- file /System/Library/Fonts/LucidaGrande.ttc
  2017-05-30 00:10:14,670 Fetch 5.7.6 (5H1671): DEBUG Copyright: Copyright � 1989 Bigelow & Holmes, Inc. All rights reserved. Lucida is a trademark of Bigelow & Holmes Inc. registered in the U.S. Patent and Trademark Office and other jurisdictions. Lucida typeface designs created by Kris Holmes and Charles Bigelow.
  2017-05-30 00:10:14,670 Fetch 5.7.6 (5H1671): DEBUG Family: Lucida Grande
  2017-05-30 00:10:14,670 Fetch 5.7.6 (5H1671): DEBUG Style: Regular
  2017-05-30 00:10:14,670 Fetch 5.7.6 (5H1671): DEBUG Unique: Lucida Grande; 10.0d1e2; 2014-09-12
  2017-05-30 00:10:14,670 Fetch 5.7.6 (5H1671): DEBUG Full: Lucida Grande
  2017-05-30 00:10:14,671 Fetch 5.7.6 (5H1671): DEBUG Version: 10.0d1e2
  2017-05-30 00:10:14,671 Fetch 5.7.6 (5H1671): DEBUG Postscript: LucidaGrande
  2017-05-30 00:10:14,671 Fetch 5.7.6 (5H1671): DEBUG Trademark: Lucida is a registered trademark of Bigelow & Holmes Inc.
  2017-05-30 00:10:14,671 Fetch 5.7.6 (5H1671): DEBUG Designer: Kris Holmes and Charles Bigelow
  2017-05-30 00:10:14,671 Fetch 5.7.6 (5H1671): DEBUG Vendor URL: http://www.agfamonotype.com
  2017-05-30 00:10:14,671 Fetch 5.7.6 (5H1671): DEBUG Designer URL: www.bigelowandholmes.com
  2017-05-30 00:10:14,671 Fetch 5.7.6 (5H1671): DEBUG License description: Do not copy. Call USA 847-718-0400 UK 44(0)1737 765959.
  2017-05-30 00:10:14,671 Fetch 5.7.6 (5H1671): DEBUG License info URL: http://www.agfamonotype.com/html/type/license.html
  2017-05-30 00:10:14,673 Fetch 5.7.6 (5H1671): DEBUG Found font named Lucida Grande (Full) -- file /System/Library/Fonts/LucidaGrande.ttc
  2017-05-30 00:10:14,673 Fetch 5.7.6 (5H1671): DEBUG Copyright: Copyright � 1989 Bigelow & Holmes, Inc. All rights reserved. Lucida is a trademark of Bigelow & Holmes Inc. registered in the U.S. Patent and Trademark Office and other jurisdictions. Lucida typeface designs created by Kris Holmes and Charles Bigelow.
  2017-05-30 00:10:14,673 Fetch 5.7.6 (5H1671): DEBUG Family: Lucida Grande
  2017-05-30 00:10:14,673 Fetch 5.7.6 (5H1671): DEBUG Style: Regular
  2017-05-30 00:10:14,674 Fetch 5.7.6 (5H1671): DEBUG Unique: Lucida Grande; 10.0d1e2; 2014-09-12
  2017-05-30 00:10:14,674 Fetch 5.7.6 (5H1671): DEBUG Full: Lucida Grande
  2017-05-30 00:10:14,674 Fetch 5.7.6 (5H1671): DEBUG Version: 10.0d1e2
  2017-05-30 00:10:14,674 Fetch 5.7.6 (5H1671): DEBUG Postscript: LucidaGrande
  2017-05-30 00:10:14,674 Fetch 5.7.6 (5H1671): DEBUG Trademark: Lucida is a registered trademark of Bigelow & Holmes Inc.
  2017-05-30 00:10:14,674 Fetch 5.7.6 (5H1671): DEBUG Designer: Kris Holmes and Charles Bigelow
  2017-05-30 00:10:14,674 Fetch 5.7.6 (5H1671): DEBUG Vendor URL: http://www.agfamonotype.com
  2017-05-30 00:10:14,674 Fetch 5.7.6 (5H1671): DEBUG Designer URL: www.bigelowandholmes.com
  2017-05-30 00:10:14,674 Fetch 5.7.6 (5H1671): DEBUG License description: Do not copy. Call USA 847-718-0400 UK 44(0)1737 765959.
  2017-05-30 00:10:14,674 Fetch 5.7.6 (5H1671): DEBUG License info URL: http://www.agfamonotype.com/html/type/license.html
  2017-05-30 00:10:14,680 Fetch 5.7.6 (5H1671): DEBUG Found font named Lucida Grande (Full) -- file /System/Library/Fonts/LucidaGrande.ttc
  2017-05-30 00:10:14,680 Fetch 5.7.6 (5H1671): DEBUG Copyright: Copyright � 1989 Bigelow & Holmes, Inc. All rights reserved. Lucida is a trademark of Bigelow & Holmes Inc. registered in the U.S. Patent and Trademark Office and other jurisdictions. Lucida typeface designs created by Kris Holmes and Charles Bigelow.
  2017-05-30 00:10:14,680 Fetch 5.7.6 (5H1671): DEBUG Family: Lucida Grande
  2017-05-30 00:10:14,680 Fetch 5.7.6 (5H1671): DEBUG Style: Regular
  2017-05-30 00:10:14,680 Fetch 5.7.6 (5H1671): DEBUG Unique: Lucida Grande; 10.0d1e2; 2014-09-12
  2017-05-30 00:10:14,681 Fetch 5.7.6 (5H1671): DEBUG Full: Lucida Grande
  2017-05-30 00:10:14,681 Fetch 5.7.6 (5H1671): DEBUG Version: 10.0d1e2
  2017-05-30 00:10:14,681 Fetch 5.7.6 (5H1671): DEBUG Postscript: LucidaGrande
  2017-05-30 00:10:14,681 Fetch 5.7.6 (5H1671): DEBUG Trademark: Lucida is a registered trademark of Bigelow & Holmes Inc.
  2017-05-30 00:10:14,681 Fetch 5.7.6 (5H1671): DEBUG Designer: Kris Holmes and Charles Bigelow
  2017-05-30 00:10:14,681 Fetch 5.7.6 (5H1671): DEBUG Vendor URL: http://www.agfamonotype.com
  2017-05-30 00:10:14,681 Fetch 5.7.6 (5H1671): DEBUG Designer URL: www.bigelowandholmes.com
  2017-05-30 00:10:14,682 Fetch 5.7.6 (5H1671): DEBUG License description: Do not copy. Call USA 847-718-0400 UK 44(0)1737 765959.
  2017-05-30 00:10:14,682 Fetch 5.7.6 (5H1671): DEBUG License info URL: http://www.agfamonotype.com/html/type/license.html
  2017-05-30 00:10:14,785 Fetch 5.7.6 (5H1671): DEBUG Found font named Monaco (Full) -- file /System/Library/Fonts/Monaco.dfont
  2017-05-30 00:10:14,785 Fetch 5.7.6 (5H1671): DEBUG Copyright: � 1990-2008 Apple Inc. � 1990-97 Type Solutions Inc. � 1990-97 The Font Bureau Inc. TrueType outline design of Monaco typeface created by Kris Holmes and Charles Bigelow.
  2017-05-30 00:10:14,785 Fetch 5.7.6 (5H1671): DEBUG Family: Monaco
  2017-05-30 00:10:14,785 Fetch 5.7.6 (5H1671): DEBUG Style: Regular
  2017-05-30 00:10:14,785 Fetch 5.7.6 (5H1671): DEBUG Unique: Monaco; 7.0d1e1; 2013-04-24
  2017-05-30 00:10:14,785 Fetch 5.7.6 (5H1671): DEBUG Full: Monaco
  2017-05-30 00:10:14,785 Fetch 5.7.6 (5H1671): DEBUG Version: 7.0d1e1
  2017-05-30 00:10:14,785 Fetch 5.7.6 (5H1671): DEBUG Postscript: Monaco
  2017-05-30 00:10:16,082 Fetch 5.7.6 (5H1671): INFO Fetch 5.7.6 (5H1671) Intel (Web Store) running on Mac OS X 10.11.6 (15G1510) Intel English
  2017-05-30 00:10:18,118 Fetch 5.7.6 (5H1671): INFO StuffIt Engine 0x820, StuffIt SDK Version 10.1.1b1
  2017-05-30 00:10:18,325 Fetch 5.7.6 (5H1671): DEBUG Found font named Lucida Grande (Full) -- file /System/Library/Fonts/LucidaGrande.ttc
  2017-05-30 00:10:18,325 Fetch 5.7.6 (5H1671): DEBUG Copyright: Copyright � 1989 Bigelow & Holmes, Inc. All rights reserved. Lucida is a trademark of Bigelow & Holmes Inc. registered in the U.S. Patent and Trademark Office and other jurisdictions. Lucida typeface designs created by Kris Holmes and Charles Bigelow.
  2017-05-30 00:10:18,325 Fetch 5.7.6 (5H1671): DEBUG Family: Lucida Grande
  2017-05-30 00:10:18,325 Fetch 5.7.6 (5H1671): DEBUG Style: Regular
  2017-05-30 00:10:18,326 Fetch 5.7.6 (5H1671): DEBUG Unique: Lucida Grande; 10.0d1e2; 2014-09-12
  2017-05-30 00:10:18,326 Fetch 5.7.6 (5H1671): DEBUG Full: Lucida Grande
  2017-05-30 00:10:18,326 Fetch 5.7.6 (5H1671): DEBUG Version: 10.0d1e2
  2017-05-30 00:10:18,326 Fetch 5.7.6 (5H1671): DEBUG Postscript: LucidaGrande
  2017-05-30 00:10:18,326 Fetch 5.7.6 (5H1671): DEBUG Trademark: Lucida is a registered trademark of Bigelow & Holmes Inc.
  2017-05-30 00:10:18,326 Fetch 5.7.6 (5H1671): DEBUG Designer: Kris Holmes and Charles Bigelow
  2017-05-30 00:10:18,326 Fetch 5.7.6 (5H1671): DEBUG Vendor URL: http://www.agfamonotype.com
  2017-05-30 00:10:18,326 Fetch 5.7.6 (5H1671): DEBUG Designer URL: www.bigelowandholmes.com
  2017-05-30 00:10:18,326 Fetch 5.7.6 (5H1671): DEBUG License description: Do not copy. Call USA 847-718-0400 UK 44(0)1737 765959.
  2017-05-30 00:10:18,326 Fetch 5.7.6 (5H1671): DEBUG License info URL: http://www.agfamonotype.com/html/type/license.html
  2017-05-30 00:10:18,734 Fetch 5.7.6 (5H1671): INFO Partial serial FETCH55001-ANN7-6ZCJ T
  2017-05-30 00:10:18,735 Fetch 5.7.6 (5H1671): INFO Connecting to XXX@rYYY.com port 22 (5/30/17, 00:10)
  2017-05-30 00:10:24,213 Fetch 5.7.6 (5H1671): INFO SSH2_FXP_INIT 3
  2017-05-30 00:10:29,188 Fetch 5.7.6 (5H1671): DEBUG Found font named Lucida Grande (Full) -- file /System/Library/Fonts/LucidaGrande.ttc
  2017-05-30 00:10:29,188 Fetch 5.7.6 (5H1671): DEBUG Copyright: Copyright � 1989 Bigelow & Holmes, Inc. All rights reserved. Lucida is a trademark of Bigelow & Holmes Inc. registered in the U.S. Patent and Trademark Office and other jurisdictions. Lucida typeface designs created by Kris Holmes and Charles Bigelow.
  2017-05-30 00:10:29,188 Fetch 5.7.6 (5H1671): DEBUG Family: Lucida Grande
  2017-05-30 00:10:29,188 Fetch 5.7.6 (5H1671): DEBUG Style: Regular
  2017-05-30 00:10:29,189 Fetch 5.7.6 (5H1671): DEBUG Unique: Lucida Grande; 10.0d1e2; 2014-09-12
  2017-05-30 00:10:29,189 Fetch 5.7.6 (5H1671): DEBUG Full: Lucida Grande
  2017-05-30 00:10:29,189 Fetch 5.7.6 (5H1671): DEBUG Version: 10.0d1e2
  2017-05-30 00:10:29,189 Fetch 5.7.6 (5H1671): DEBUG Postscript: LucidaGrande
  2017-05-30 00:10:29,189 Fetch 5.7.6 (5H1671): DEBUG Trademark: Lucida is a registered trademark of Bigelow & Holmes Inc.
  2017-05-30 00:10:29,189 Fetch 5.7.6 (5H1671): DEBUG Designer: Kris Holmes and Charles Bigelow
  2017-05-30 00:10:29,189 Fetch 5.7.6 (5H1671): DEBUG Vendor URL: http://www.agfamonotype.com
  2017-05-30 00:10:29,189 Fetch 5.7.6 (5H1671): DEBUG Designer URL: www.bigelowandholmes.com
  2017-05-30 00:10:29,189 Fetch 5.7.6 (5H1671): DEBUG License description: Do not copy. Call USA 847-718-0400 UK 44(0)1737 765959.
  2017-05-30 00:10:29,189 Fetch 5.7.6 (5H1671): DEBUG License info URL: http://www.agfamonotype.com/html/type/license.html
  2017-05-30 00:10:34,236 Fetch 5.7.6 (5H1671): INFO Connecting to XXX@rYYY.com port 22 (5/30/17, 00:10)
  2017-05-30 00:10:36,646 Fetch 5.7.6 (5H1671): INFO SSH2_FXP_INIT 3
  2017-05-30 00:12:16,529 Fetch 5.7.6 (5H1671): INFO Update check skipped at 5/30/17, 00:12 (next check after 5/30/17, 22:19)

  *** Log End

  The only thing I see that it of concern is the Automatic Fetch Update Check (it says Check Skipped) - but I have turned this Off now via the Preferences.

  Regards -

  Paul

  Posted 6 years ago #

• Jim Matthews Administrator

  Hi,

  Thanks for posting the Fetch.log; I apologize for taking so long to get back to you. Unfortunately the log doesn't say much about why the connection attempt is failing.

  My next suggestion would be to turn on additional logging, and see if that captures useful information. To do this:

  1) Open Fetch
  2) Hold down Command, Option, Control and Shift and type the letter d; a Debug menu should appear in the menu bar
  3) Choose Debug > Logging > SFTP log
  4) Leave Fetch running

  Then, the next time your Automator action fails to connect, send me the Fetch.log file at bbugs@fetchsoftworks.com .

  Thanks,

  Jim Matthews
  Fetch Softworks

  Posted 6 years ago #

• Paul Member

  Hi Jim -

  Just something I'd like to mention. Ever since I turned off "Automatically Check for Updates" in Preferences everything is just running smoothly. No errors; nothing. Maybe something to do with this?

  The Fetch Automator workflow contains a Quit Application (Fetch) once the workflow is executed. I'll have to modify the Workflow which I'm a little hesitant to. What I'll have to do is setup an alternate/parallel system to run the exact same workflow but remove the Quit Application action (I'll just run it at a slightly different time). I'll need some time to set this up.

  Posted 6 years ago #

• Jim Matthews Administrator

  I'm glad to hear that it's running smoothly now. I don't know why checking for updates would interfere with transfers, but if it works that's what matters.

  Thanks,

  Jim Matthews
  Fetch Softworks

  Posted 6 years ago #