Author Topic: Offline Scantool (for X2 models)  (Read 32745 times)

Offline Lupissimo

  • Senior Member
  • ***
  • Posts: 386
  • Helpful Contribution Status: +4/-0
Offline Scantool (for X2 models)
« on: March 04, 2012, 06:02:18 pm »
Is there a chance to get an Offline Scantool such that the scan via the  Mede8er is no longer necessary. I assume it would be much faster using a PC for scanning a NAS via the network and it would create the Mede8er.db file. I have a 400X2 with no direct storage attached, so all required information is in the mede8er.db file I assume.  
« Last Edit: April 20, 2012, 05:23:00 pm by Maasbommel »

Offline Maasbommel

  • Global Moder8or
  • M8er Addict
  • *****
  • Posts: 11 503
  • Helpful Contribution Status: +51/-8
Re: Offline Scantool
« Reply #1 on: March 04, 2012, 10:34:28 pm »
Did you try tagscan?
It does not create the db file, but scanning of the created xml goes much faster then using the mede8er mp3 tagscan.

But if you count the Tagscan + xml import, it takes together about the same time as scan from mede8er mp3 scan.
Read the  Mede8er 400X/500X Beginners Guide
or Mede8er 500X2/400X2/450X2 Beginners Guide

Also check the Couto X3D Newbies Guide first.

Please don't PM me but post on the forum.

Offline Lupissimo

  • Senior Member
  • ***
  • Posts: 386
  • Helpful Contribution Status: +4/-0
Re: Offline Scantool
« Reply #2 on: March 05, 2012, 05:57:47 am »
I was probably not clear enough in my request: I was talking about VIDEOs where the xmls allready exist, not music. If we could have the format of the db file, it would not be difficult to write this small program.

Offline Lupissimo

  • Senior Member
  • ***
  • Posts: 386
  • Helpful Contribution Status: +4/-0
Re: Offline Scantool
« Reply #3 on: March 07, 2012, 10:02:37 pm »
As I am about to program this Offline Scantool it would be a great help if you could let me know, what the parameter "Rating" in the mede8er.db stands for or where you get it from and what it is used for. It does not seem to be the imdb Rating since the value is only Integer and does not match the rating in the xml file. I have only found values between 3 and 5 thru all 3000 movies in the mede8er.db.
I am looking forward to your answer

Lupissimo

Offline Maasbommel

  • Global Moder8or
  • M8er Addict
  • *****
  • Posts: 11 503
  • Helpful Contribution Status: +51/-8
Re: Offline Scantool
« Reply #4 on: March 08, 2012, 02:29:06 pm »
It should be the IMDB figure like this:

We get from IMDB Rating = '81'
so we divide by 2 and take it to the nearest full digit
So '81' will get a rating of '4' in the db
Read the  Mede8er 400X/500X Beginners Guide
or Mede8er 500X2/400X2/450X2 Beginners Guide

Also check the Couto X3D Newbies Guide first.

Please don't PM me but post on the forum.

Offline Lupissimo

  • Senior Member
  • ***
  • Posts: 386
  • Helpful Contribution Status: +4/-0
Re: Offline Scantool
« Reply #5 on: March 08, 2012, 06:06:09 pm »
Thank you!!
Just curious why dont you use the imdb figure directly. It ranges from 0.0 to 10.0.
But anyway, I will of course use your algorithm!
 

Offline Unreal

  • B8a Tester - X2
  • Experienced Member
  • ****
  • Posts: 228
  • Helpful Contribution Status: +1/-0
    • UnrealRG Home Page
Re: Offline Scantool
« Reply #6 on: April 09, 2012, 04:27:06 am »
I suspect this is because many skins display the IMDB rating as stars...5 stars takes less display space than 10.   ;D
« Last Edit: April 11, 2012, 05:23:09 pm by Unreal »
MED450X2 with PCIe Wireless                                 Firmware 3.0.2, NAS off, DLNA DMR&DMS enabled
Samsung LED HDTV (UN46C6300)                           Windows 7 Enterprise x64 SP1
Samsung USB Drives [2x2TB] (HX-DT020EB/B62)      Asus RT-N66U Router (FW 3.0.0.4.260)
Analog audio output to Pioneer Receiver (VSX-516)   HDMI audio output to HDTV

Offline mognons

  • B8a Tester - 1000X3D
  • Experienced Member
  • ****
  • Posts: 209
  • Helpful Contribution Status: +0/-0
  • printf("Hello, world! \n");
    • myrtaART: Applications, Resources and Tools
Re: Offline Scantool
« Reply #7 on: April 10, 2012, 08:02:10 am »
I have a couple of questions on the same subject:
what is the exact  algorithm used to build the hash code?
How it is used by the mede8er firmware?

I'm writing a series of script to build and maintain a centralized DB  of my movies and TV series, scattered over 2 disks and 2 different network locations and I would like to integrate them with direct support to mede8er.db: automatic updates, integrity check against central DB and other cool stuff...

Thanks in advance for any support or info about it.

m.
Mede8er 1000X3D, Onkyo HT-R390, LG 47LW570G (3D, DTT+SAT, LED Local dimming), LG BD-660 (Bluray 3D player), Apple TV (3rd gen.)
Proud user of DuneX2Mede8er

Offline mognons

  • B8a Tester - 1000X3D
  • Experienced Member
  • ****
  • Posts: 209
  • Helpful Contribution Status: +0/-0
  • printf("Hello, world! \n");
    • myrtaART: Applications, Resources and Tools
Re: Offline Scantool
« Reply #8 on: April 10, 2012, 11:17:58 am »
what is the exact  algorithm used to build the hash code?
Ok, never mind this question, I've got it.
It look like an MD5 of the string in column "Folder"  ;)

What is that value used for?
Also... timestamp is calculated as what? Days/minutes/seconds since some time?

m.
Mede8er 1000X3D, Onkyo HT-R390, LG 47LW570G (3D, DTT+SAT, LED Local dimming), LG BD-660 (Bluray 3D player), Apple TV (3rd gen.)
Proud user of DuneX2Mede8er

Offline Lupissimo

  • Senior Member
  • ***
  • Posts: 386
  • Helpful Contribution Status: +4/-0
Re: Offline Scantool
« Reply #9 on: April 10, 2012, 12:49:17 pm »
As I have no insight into the mede8er code I can only guess that the hashcode is used to skip already existing movies by comparison while scanning. The timestamp is the" win last write" translated into unix time:
Win LastWrite =  LocalFileTimeToDateTime(LastWriteFileTime))
Local Time, not UTC
UnixTime  =  FileTimeToUnixTime(LastWriteFileTime))
for example:
Win LastWrite = 10.12.2010 21:25:26
UnixTime      = 1292016325
and is probably used to sort for actuality.
« Last Edit: April 11, 2012, 01:49:31 am by Lupissimo »

Offline mognons

  • B8a Tester - 1000X3D
  • Experienced Member
  • ****
  • Posts: 209
  • Helpful Contribution Status: +0/-0
  • printf("Hello, world! \n");
    • myrtaART: Applications, Resources and Tools
Re: Offline Scantool
« Reply #10 on: April 11, 2012, 12:19:39 am »
Thank you, Lupissimo!
I've got a working comparison between my centralized DB and various mede8er.db scattered over physical and networked disks, useful to detect if a rescan of some favorite folder is needed due to new files being added or due to badly or attend XMLs.
Next step: build database with data from my own central DB and forward it to the right location as accessed by . No more need to have the med scanning and make a crap out of my files (see firmware 2.05/2.06 issues)
Mede8er 1000X3D, Onkyo HT-R390, LG 47LW570G (3D, DTT+SAT, LED Local dimming), LG BD-660 (Bluray 3D player), Apple TV (3rd gen.)
Proud user of DuneX2Mede8er

Offline Unreal

  • B8a Tester - X2
  • Experienced Member
  • ****
  • Posts: 228
  • Helpful Contribution Status: +1/-0
    • UnrealRG Home Page
Re: Offline Scantool
« Reply #11 on: April 11, 2012, 03:36:59 pm »
mognons and Lupissimo,

I am VERY interested in an offline scan tool that could be run on a PC, and just transfer the db file to the mede8er.  Please keep us informed as to your progress.

It seems to me the vast majority, if not all, of the corruption that has happened on my mede8er was due to scans, both movies and music.  I realize you are only working on the movie db part, but it could be a great help until Sanji have an official fix.  The corruption almost always happens in the parent directory for the "corrupt" file.  That is, the directory entry for the file is corrupted, not the file itself.  More info here...

http://www.mede8erforum.com/index.php/topic,8253.msg52260.html#msg52260
MED450X2 with PCIe Wireless                                 Firmware 3.0.2, NAS off, DLNA DMR&DMS enabled
Samsung LED HDTV (UN46C6300)                           Windows 7 Enterprise x64 SP1
Samsung USB Drives [2x2TB] (HX-DT020EB/B62)      Asus RT-N66U Router (FW 3.0.0.4.260)
Analog audio output to Pioneer Receiver (VSX-516)   HDMI audio output to HDTV

Offline Unreal

  • B8a Tester - X2
  • Experienced Member
  • ****
  • Posts: 228
  • Helpful Contribution Status: +1/-0
    • UnrealRG Home Page
Re: Offline Scantool
« Reply #12 on: April 11, 2012, 03:55:57 pm »
Clarification about the rating...

Although the IMDB ratings only go up to 10, they do use one decimal point.  You can have a rating on IMDB of 8.5.  However, this will download to the xml files as 85 (not 8.5), so it appears the scale is to 100 (10.0).  In the movie jukebox, there is an option to show movies by ratings, 1-5, which is why Sanji divide the rating by 2 and round when storing the rating in the db.  The end result stored in the movie db is a whole number between 1 and 5, to match the jukebox option.
MED450X2 with PCIe Wireless                                 Firmware 3.0.2, NAS off, DLNA DMR&DMS enabled
Samsung LED HDTV (UN46C6300)                           Windows 7 Enterprise x64 SP1
Samsung USB Drives [2x2TB] (HX-DT020EB/B62)      Asus RT-N66U Router (FW 3.0.0.4.260)
Analog audio output to Pioneer Receiver (VSX-516)   HDMI audio output to HDTV

Offline mognons

  • B8a Tester - 1000X3D
  • Experienced Member
  • ****
  • Posts: 209
  • Helpful Contribution Status: +0/-0
  • printf("Hello, world! \n");
    • myrtaART: Applications, Resources and Tools
Re: Offline Scantool
« Reply #13 on: April 11, 2012, 04:16:13 pm »
Unreal, my goal is exactly that: scan offline to avoid problems with mede8er firmware. I've almost 600 movies, most of them weighing more than 5 gigabytes, and the collection is rapidly growing: it's easier for me to one offline scan every couple of days and have the appropriate mede8er.db(s) created on the fly and placed at the "root" of each favorite folder.

My tool will run only on Mac OSX due to it being written in Applescript and heavy relying on features available, out of the box, only on OSX or Linux (SQLite access, just to mention one).

Work is in progress:
1) folder structure scan is working
2) XML parsing is up 'n' running
3) central DB is built with info from XML files and can be exported to Excel worksheets for easy reporting
4) Check for consistency between central DB and single mede8er db(s) is working

TBD: creation of mede8er db
Mede8er 1000X3D, Onkyo HT-R390, LG 47LW570G (3D, DTT+SAT, LED Local dimming), LG BD-660 (Bluray 3D player), Apple TV (3rd gen.)
Proud user of DuneX2Mede8er

Offline Unreal

  • B8a Tester - X2
  • Experienced Member
  • ****
  • Posts: 228
  • Helpful Contribution Status: +1/-0
    • UnrealRG Home Page
Re: Offline Scantool
« Reply #14 on: April 11, 2012, 05:21:34 pm »
Thank you mognons for that info, though I don't use Apple.

Lupissimo, what OS are you developing your program for, and how is it progressing?
MED450X2 with PCIe Wireless                                 Firmware 3.0.2, NAS off, DLNA DMR&DMS enabled
Samsung LED HDTV (UN46C6300)                           Windows 7 Enterprise x64 SP1
Samsung USB Drives [2x2TB] (HX-DT020EB/B62)      Asus RT-N66U Router (FW 3.0.0.4.260)
Analog audio output to Pioneer Receiver (VSX-516)   HDMI audio output to HDTV