Welcome to the Invelos forums. Please read the forum rules before posting.

Read access to our public forums is open to everyone. To post messages, a free registration is required.

If you have an Invelos account, sign in to post.

Invelos Forums->Posts by mediadogg Page: 1 2 3 ...11  Previous   Next
Message Details
Quoting AiAustria:
Quote:
No, I did mean XML.

But CSV would be even handier: The first thing I do with a XML is importing it into Excel; and CSV would import faster...

Ok, here is one CSV and one text file as basically a list. The CSV file has the titles and some other info. Just two ways I can easily give you stuff, compare and next time (?) you can say which one you want.

Clint Eastwood CLT ProfileID List 3174 expecting 3173

Danny Devito profile IDs expecting 2562 got 2564
Posted:
Topic Replies: 349, Topic Views: 16670
Quoting AiAustria:
Quote:
If you provide a Danny DeVito CSV...

Thanks, do you really mean CSV, and not XML? Of course the CSV is a smaller file than the XML, and is basically a list of the profile IDs, so maybe easier to handle than the XML.
Posted:
Topic Replies: 349, Topic Views: 16670
Danny DeVito still 2564 / 2562

Tom Cruise 3033 / 3033 

On to Clint Eastwood
Posted:
Topic Replies: 349, Topic Views: 16670
Danny DeVito expected 2562, I get 2564. 

Letting that go for the moment. Can't expect anybody to mess with that big a file.

I implemented a "bad apples" report that is saved out to disk. All the unique "hidden" locality 0 profile/UPCs that are in the database, but don't show up in the list of profiles connected to that UPC.

Here is the list so far, in case anybody wants to play with it. When CLTBoss is released, I might start a thread to keep track, in case Invelos ever is able to do some clean up.

On to more testing of the big boys and girls.

[086162000355]
[065935141952]
[065935222491]
[883929177752]
[065935144489]
[057373146231]
[025192151439]
[065935133254]
[065935808640]
[065935225607]
[097361243269]
[086162180057]
[883929040032]
[044004336628]
[7036988001091]
[065935125600]
[065935142669]
[7898512962328]
[625828617386]
[065935141150]
[8013123023681]
[085393328214]
[097363433668]
[097361199269]
[097360704563]
[097361198965]
[097363398769]
[678149019025]
[678149019124]
[086162209185]
[097360420463]
[883904138150]
[097363393665]

(Edit: thought I was checking for dups, but I thought I just noticed one)
Posted:
Topic Replies: 349, Topic Views: 16670
Hey now, we are getting somewhere! You are telling me the WHY, so I am satisfied.

I just coded the HOW, and it worked.

So it is all good! 

Waddda team!
Posted:
Topic Replies: 349, Topic Views: 16670
Well there has to be some way to weed them out. I just gave one version before. Not in the UPC list, then ignore. But why?
Posted:
Topic Replies: 349, Topic Views: 16670
Quoting AiAustria:
Quote:
Quoting mediadogg:
Quote:
And more interesting. The thumbnail link works for one profile, but gives an error on the other. WTF?????

Yet, the covers show when downloaded:

... but this screenshot shows a Region 4 Profile, which cannot be a US profile. - ??

Tell that to Invelos. Somehow the profiles must be cross-linked in the database. I didn't create those cover scans or the profiles.
Posted:
Topic Replies: 349, Topic Views: 16670
By the way, this is no crusade. Just code. So, if there is some reason that I should legitimately consider profiles like these to be invalid, and thereby exclude them, then all I need are the criteria so that I can write the code. If you can describe how to identify the bad apples, I can write the code.

I mean, yes I can write "if a get a profile that is not in the list returned by the UPC call, then ignore it" ...

But why?
Posted:
Topic Replies: 349, Topic Views: 16670
To complete the story, here is what things look like when the database call shows the US profile:

"Give me all profiles for the UPC 025192516726"

tpids
{object[2]}
    [0]: "025192516726"
    [1]: "025192516726.3"

You see that the locality 0 profile is included in the list, with exactly the same format as the UPC.
Posted:
Topic Replies: 349, Topic Views: 16670
So, we are on the same page. 

The CLT misses those three profiles that actually ARE in the database! I told you, I downloaded them into my local database, using the plugin online access.

Here is how the API works. I will not reveal the actual API, as Invelos told me not to:

(1) Ask Invelos "give me all profile IDs" based on UPC "086162000355":

tpids
{object[2]}
    [0]: "086162000355.25"
    [1]: "086162000355.49"

(2) Ask Invelos "give me a pointer to the profile with profile ID = "086162000355"

- get non-null pointer (you get a null pointer if the profile does not exist)
- (pointer).GetProfileID() yields "086162000355"
- (pointer).GetXML() yields the XML in the file I gave a link to

This is the part of the Invelos database key scheme that leads to errors. There is no way to tell the difference between a UPC and a locality 0 profile ID.

For example, if you ask: "give me a pointer to profile ID "086162000355.0", you get a null pointer!!!

Of course, the other localities work just as they should.

Bottom line. There is a bug lurking in the Invelos Online, that sometimes misses presenting the locality 0 profile, even though it exists in the database.

I find them. CLT does not.
Posted:
Topic Replies: 349, Topic Views: 16670
Quoting AiAustria:
Quote:
All three Profiles exist in other locations:
065935141952-Canada
065935141952-Canada (Quebec)
065935141952-United States

065935222491-Canada
065935222491-Canada (Quebec)
065935222491-United States

086162000355-Chile
086162000355-Mexico
086162000355-United States


How did you generate this list?
Posted:
Topic Replies: 349, Topic Views: 16670
I don't understand what you mean?

Quoting AiAustria:
Quote:

If I had to guess, I'd look for some loose variable binding, which equals the locality 0 with an empty string...



You just told me that 086162000355 did not exist for US Locality.

Quoting AiAustria:
Quote:
The profiles, which seem not to exist in the data base:
065935141952-United States
065935222491-United States
086162000355-United States


And in fact when I did a UPC search, it didn't show. That has nothing to do with my code. Nor does the error on the thumbnail.

What am I missing?
Posted:
Topic Replies: 349, Topic Views: 16670
And more interesting. The thumbnail link works for one profile, but gives an error on the other. WTF?????

Yet, the covers show when downloaded:
Posted:
Topic Replies: 349, Topic Views: 16670
<DVD>
  <ID>086162000355</ID>
  <ID_Base>086162000355</ID_Base>
  <ID_LocalityID>0</ID_LocalityID>
  <ID_LocalityDesc>United States</ID_LocalityDesc>
  <Title>Delgada Linea Roja</Title>
  <OriginalTitle></OriginalTitle>
  <MediaTypes>
    <DVD>True</DVD>
    <BluRay>False</BluRay>
    <HDDVD>False</HDDVD>
    <UltraHD>False</UltraHD>
  </MediaTypes>
  <ProductionYear>1998</ProductionYear>
  <Released>11/2/1999</Released>
  <FrontCoverThumbnailUrl>http://www.invelos.com/thumbs/08/086162000355f.jpg</FrontCoverThumbnailUrl>
  <BackCoverThumbnailUrl>http://www.invelos.com/thumbs/08/086162000355b.jpg</BackCoverThumbnailUrl>
  <Actors>
    <Actor Episode="" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" Role="Private Hoke" CreditedAs="" Voice="False" Uncredited="False" Puppeteer="False" />
  </Actors>
  <Credits>
  </Credits>
</DVD>

Interesting, this doesn't come up when I type the UPC into the Add To Collection!

Mystery solved? Is is truly the case that CLTBoss finds credits that CLT does not?

Maybe these are contributions pending approval?

(I just used CLTBoss to download the profile and added to my collection)
Posted:
Topic Replies: 349, Topic Views: 16670
Wait, I am looking at the XML that includes 065935141952, US.

You know of course that I am getting this information from database calls to the online database.

<DVD>
  <ID>065935141952</ID>
  <ID_Base>065935141952</ID_Base>
  <ID_LocalityID>0</ID_LocalityID>
  <ID_LocalityDesc>United States</ID_LocalityDesc>
  <Title>I Am Sam</Title>
  <OriginalTitle></OriginalTitle>
  <MediaTypes>
    <DVD>True</DVD>
    <BluRay>False</BluRay>
    <HDDVD>False</HDDVD>
    <UltraHD>False</UltraHD>
  </MediaTypes>
  <ProductionYear>2001</ProductionYear>
  <Released>6/18/2002</Released>
  <FrontCoverThumbnailUrl>http://www.invelos.com/thumbs/06/065935141952f.jpg</FrontCoverThumbnailUrl>
  <BackCoverThumbnailUrl>http://www.invelos.com/thumbs/06/065935141952b.jpg</BackCoverThumbnailUrl>
  <Actors>
    <Actor Episode="" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" Role="Bill Carpenter" CreditedAs="" Voice="False" Uncredited="False" Puppeteer="False" />
  </Actors>
  <Credits>
  </Credits>
</DVD>


So, what does it mean that you say they do not exist? Does it mean that you can't download them, using the "Add To Collection"?
Posted:
Topic Replies: 349, Topic Views: 16670
Quoting AiAustria:
Quote:
The profiles, which seem not to exist in the data base:
065935141952-United States
065935222491-United States
086162000355-United States

Wow! Quick work, and just what I needed to figure things out.

I will check it out.
Posted:
Topic Replies: 349, Topic Views: 16670
Danny Devito expecting 2562, got 2573. Always the big boys. 
Posted:
Topic Replies: 349, Topic Views: 16670
Well of course I blew everything up while enhancing divider parsing, BY recognition and testing with multiple name variants.

I think things have settled back down now, but I still get consistently the same number of "extra" profiles with some actors. Are they legitimate, or do I have a bug that I just can't find?

If anybody wants to take a shot at helping me figure it out, here is an example: Will Wallace. Current CLT says 379 profiles. I consistently get 382. Have been getting the extra for a long time now. Always with the same actors, but not every actor.

Will Wallace CLT profiles, CLTBoss "skinny" XML.

Will Wallace CLT profiles, Invelos full XML.

Are the 3 extra musketeers for real??? 

And of course I will painfully suffer the news of any other issues you find. 
Posted:
Topic Replies: 349, Topic Views: 16670
Side note: there are a few plugins that allow you to define and maintain custom fields ("Real Name"?). Custom fields can be filtered and used in HTML sections like regular fields, and are saved and restored with the database. Just not contributed. Advantage is that if someday in the future (ha!!), that field becomes supported by the main program, a simple tool can be generated to copy the data over to the supported field. Not intending to hijack the thread. No soapbox. Just an FYI.
Posted:
Topic Replies: 18, Topic Views: 248
Oh boy, I'm way out on a limb here ...

But based on the discussion, my opinion would be to lean towards the Invelos rules. Not for any philosophical reason, but for a practical one. If the rule is "copy exactly what you see," then the determination of what is right or wrong to be in the profile is clear. No need to ask any opinion, or make someone justify the difference. If an actor trusted that to be the case, he(she) could even use that information in a legal proceeding to reconcile a royalty dispute. But if anybody could just change the reading of the credits to suit their own view of correctness (regardless of whether it is actually correct), then you basically erode the standard of reference.
Posted:
Topic Replies: 18, Topic Views: 248
Ah hah! Now I got it. Old 'Dogg bites too soon as usual. 
Posted:
Topic Replies: 18, Topic Views: 248
Well, with all due respect surfeur51, there might be other types of users. I am always totally in awe of the passion of this community for getting things right. And in cases like this, there is not always agreement on what is right. I don't think it is fair to bash another user who has the same passion, if they have a different point of view on what is right.

And users like myself, who don't make contributions (the majority of users don't I think), maybe we are lazy, or maybe we lack the patience or expertise.

Personally, I try to contribute in other ways. But even the users that don't contribute or use the Forums, appreciate and benefit from the best database.

So keep up the good work, and don't for a minute think that people don't enjoy the correct details just because they don't contribute!
Posted:
Topic Replies: 18, Topic Views: 248
Quoting GSyren:
Quote:
I could be mistaken, but I believe that initially there was only one type of divider, so old profiles might have Episode dividers where we would now use Group dividers.

I think it would be very difficult for a tool to determine if end dividers are missing, or if the groups are intended to be levelled, or detemine if a divider is the wrong type.

I agree. I was thinking of some kind of interactive thing similar to Profiler Cast / Crew edit. Two panes, one on the left showing the existing setup, and one on the right showing just the dividers. User would adjust dividers, add and delete, then drag and drop people from the left-hand side to the right. Save the profile when done.
Contribute as appropriate.

Maybe that's no better than the existing editing form, now that I think about it.
Posted:
Topic Replies: 349, Topic Views: 16670
Oh man, is the Invelos database a mess!

The first UPC, locality 0 yields credits with nested dividers only because the submitter did not end the groups.

You would not expect that "Officers", "Crew", and "Others" would logically be nested.

I randomly picked one of the actors from that one, and did a CLT and bumped into this profile 4030521181533.5, which has exactly the same Captions (Officers, Crew, Others) assigned to Episode dividers. I thought I had a bug until I looked at the original profile. Clearly the submitter mistakenly used Episode dividers for what should have been groups.

I wonder if either my tool or yours should give the option to "override" such mistakes and examine the results to see if it makes sense to schedule a profile update?

- substitute Episode for Group or vice-versa
- supply missing end dividers

Does this call for a "Divider clean-up tool"? 
Posted:
Topic Replies: 349, Topic Views: 16670
Quoting GSyren:
Quote:
I think you've got it, but ...

There may be old profiles from before multiple levels were supported. Those can have groups that are supposed to be at the same level, but no longer are because the groups lack end dividers. I don't think there's much that can be done about that, except someone correcting those profiles.

Also, end dividers are not used for episodes, only for groups. In the widow for adding dividers they are explicitly called "Group End".

Ah thanks. Very helpful additional info.
Posted:
Topic Replies: 349, Topic Views: 16670
Invelos Forums->Posts by mediadogg Page: 1 2 3 ...11  Previous   Next